-- Logs begin at Sun 2022-08-07 00:10:47 UTC, end at Sun 2022-08-07 01:40:07 UTC. -- Aug 07 01:08:16.767803 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 01:08:16.777496 dv-cinder-master-3-smb devstack@n-api.service[103772]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 01:08:16 2022] *** Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: nodename: dv-cinder-master-3-smb Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: machine: x86_64 Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: clock source: unix Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: pcre jit disabled Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: detected number of CPU cores: 4 Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: current working directory: / Aug 07 01:08:16.779417 dv-cinder-master-3-smb devstack@n-api.service[103772]: detected binary path: /usr/bin/uwsgi-core Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: your processes number limit is 47680 Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: your memory page size is 4096 bytes Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: detected max file descriptor number: 2048 Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: lock engine: pthread robust mutexes Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: thunder lock: enabled Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 01:08:16.780122 dv-cinder-master-3-smb devstack@n-api.service[103772]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 01:08:16.818964 dv-cinder-master-3-smb devstack@n-api.service[103772]: Python main interpreter initialized at 0x55ea6e6629c0 Aug 07 01:08:16.818964 dv-cinder-master-3-smb devstack@n-api.service[103772]: python threads support enabled Aug 07 01:08:16.818964 dv-cinder-master-3-smb devstack@n-api.service[103772]: your server socket listen backlog is limited to 100 connections Aug 07 01:08:16.818964 dv-cinder-master-3-smb devstack@n-api.service[103772]: your mercy for graceful operations on workers is 90 seconds Aug 07 01:08:16.819284 dv-cinder-master-3-smb devstack@n-api.service[103772]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 01:08:16.819361 dv-cinder-master-3-smb devstack@n-api.service[103772]: *** Operational MODE: preforking *** Aug 07 01:08:16.819622 dv-cinder-master-3-smb devstack@n-api.service[103772]: *** uWSGI is running in multiple interpreter mode *** Aug 07 01:08:16.819622 dv-cinder-master-3-smb devstack@n-api.service[103772]: spawned uWSGI master process (pid: 103772) Aug 07 01:08:16.819804 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 07 01:08:16.821129 dv-cinder-master-3-smb devstack@n-api.service[103772]: spawned uWSGI worker 1 (pid: 103773, cores: 1) Aug 07 01:08:16.822693 dv-cinder-master-3-smb devstack@n-api.service[103772]: spawned uWSGI worker 2 (pid: 103774, cores: 1) Aug 07 01:08:16.822693 dv-cinder-master-3-smb devstack@n-api.service[103772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 01:08:17.481885 dv-cinder-master-3-smb devstack@n-api.service[103774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:08:17.491379 dv-cinder-master-3-smb devstack@n-api.service[103773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:08:18.568415 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:18.568415 dv-cinder-master-3-smb devstack@n-api.service[103774]: from cryptography.utils import int_from_bytes Aug 07 01:08:18.569012 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:18.569012 dv-cinder-master-3-smb devstack@n-api.service[103774]: from cryptography.utils import int_from_bytes Aug 07 01:08:18.569777 dv-cinder-master-3-smb devstack@n-api.service[103773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:18.569777 dv-cinder-master-3-smb devstack@n-api.service[103773]: from cryptography.utils import int_from_bytes Aug 07 01:08:18.570252 dv-cinder-master-3-smb devstack@n-api.service[103773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:18.570252 dv-cinder-master-3-smb devstack@n-api.service[103773]: from cryptography.utils import int_from_bytes Aug 07 01:08:21.067568 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:08:21.068652 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:08:21.068878 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:08:21.069244 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:08:21.069330 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:08:21.069442 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:08:21.069658 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:08:21.069746 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:08:21.070065 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:08:21.070172 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.070316 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:08:21.070417 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.070698 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.070786 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071028 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071126 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071355 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071442 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071663 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071756 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.071986 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072089 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072298 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072381 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072621 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072719 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072882 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.072966 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.073199 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.073283 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.073507 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.073600 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.074126 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.074213 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.074303 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.075627 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.075627 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.075627 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.075627 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.075966 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077082 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077082 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077082 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077458 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077572 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.077810 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078012 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078148 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078431 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078517 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078774 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.078904 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079105 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079202 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079418 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079554 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079766 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.079862 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080112 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080249 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080436 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080519 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080752 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.080958 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081170 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081265 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081485 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081569 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081794 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.081902 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082145 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082241 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082471 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082571 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082782 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.082919 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.083111 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.083198 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.083985 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.084416 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.084661 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.084748 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.084987 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085082 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085294 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085469 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085613 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085794 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.085948 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086139 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086288 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086462 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086549 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086855 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.086942 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087110 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087205 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087420 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087507 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087744 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.087830 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088068 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088153 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088392 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088489 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088648 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088735 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.088900 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089042 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089223 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089367 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089585 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089678 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.089924 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090013 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090239 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090373 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090552 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090637 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090862 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.090948 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091170 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091256 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091481 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091568 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091753 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.091838 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092159 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092391 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092476 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092707 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.092810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093032 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093118 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093291 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093383 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093549 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093644 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.093891 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094057 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094219 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094311 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094534 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094628 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094847 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.094934 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095161 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095252 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095476 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095570 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095789 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.095920 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096102 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096188 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096412 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096498 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096722 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.096807 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097032 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097115 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097350 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097444 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097676 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.097770 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098008 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098111 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098264 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098349 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098567 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098721 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.098915 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099016 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099302 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099386 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099647 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099825 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.099973 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100139 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100286 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100450 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100613 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100755 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.100940 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101067 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101253 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101378 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101565 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101687 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.101905 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102016 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102232 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102326 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102568 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102660 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102880 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.102967 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103138 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103223 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103444 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103528 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103754 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.103848 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104077 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104162 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104389 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104473 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104694 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.104786 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105001 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105086 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105305 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105391 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105614 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105706 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.105951 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106039 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106260 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106360 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106567 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106655 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106878 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.106962 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107184 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107268 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107496 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107590 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107803 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.107887 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108110 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108426 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108522 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108727 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.108813 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109035 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109135 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109364 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109456 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109650 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109742 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.109983 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110089 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110288 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110372 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110596 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110681 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.110904 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111001 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111214 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111302 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111523 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111608 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111827 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.111925 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112130 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112215 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112443 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112533 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112758 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.112857 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113064 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113149 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113374 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113466 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113679 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.113766 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.114025 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.114110 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.114340 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.114437 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.114704 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.114802 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.115073 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.115230 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.115492 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.115578 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.115833 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.115928 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.116159 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.116243 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.116475 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.116606 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.116788 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.116881 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.117097 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.117183 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.117423 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.117518 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.117743 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.117880 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.118083 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.118168 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.118398 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.118496 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.118711 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.118798 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.119030 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.119115 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:21.119364 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.119457 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.119686 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.119775 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120008 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120094 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120334 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120428 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120650 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120737 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.120974 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121059 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121305 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121399 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121622 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121721 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.121957 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122045 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122299 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122395 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122620 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122707 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.122941 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123035 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123259 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123347 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123575 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123658 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123889 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.123975 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124205 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124365 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124521 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124617 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124840 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.124925 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125168 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125255 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125485 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125570 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125801 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.125922 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126141 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126273 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126458 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126545 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126772 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.126865 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127083 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127169 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127397 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127483 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127734 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.127828 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128050 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128143 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128385 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128486 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128681 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128775 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.128998 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129083 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129311 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129395 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129622 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129715 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.129961 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.130052 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.130830 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.130935 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131192 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131281 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131502 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131586 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131819 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.131911 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132129 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132217 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132445 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132529 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132764 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.132850 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133072 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133168 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133410 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133495 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133721 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.133807 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134064 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134151 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134379 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134463 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134694 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.134786 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135001 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135091 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135316 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135401 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135629 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135722 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.135940 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136025 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136252 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136395 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136562 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136657 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136870 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.136955 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137191 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137276 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137502 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137665 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137813 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.137936 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138154 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138248 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138472 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138570 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138785 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.138870 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139099 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139183 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139411 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139503 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139721 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.139807 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140041 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140126 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140351 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140444 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140659 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140743 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.140995 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141081 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141302 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141388 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141611 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141695 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.141967 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142056 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142281 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142367 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142717 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142901 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.142994 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143292 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143525 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143635 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143819 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.143922 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144132 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144216 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144434 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144519 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144742 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.144841 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145048 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145142 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145356 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145442 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145663 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.145886 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.146566 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.146670 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.146874 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147004 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147181 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147295 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147489 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147622 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147796 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.147934 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148141 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148255 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148449 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148570 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148794 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.148879 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.149131 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.149218 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.149453 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.149545 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.149775 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150004 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150098 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150184 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150406 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150492 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150715 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.150810 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151030 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151116 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151349 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151442 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151661 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151753 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.151972 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152059 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152282 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152376 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152590 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152685 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152898 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.152982 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153226 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153320 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153542 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153637 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153885 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.153976 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154197 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154285 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154518 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154605 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154853 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.154938 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155178 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155270 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155493 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155586 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155808 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.155893 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156125 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156218 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156438 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156524 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156753 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.156846 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157151 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157376 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157462 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157691 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.157784 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158041 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158144 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158353 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158446 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158675 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158759 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.158984 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159077 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159304 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159391 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159614 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159706 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.159936 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160029 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160243 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160327 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160562 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160647 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160892 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.160988 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161211 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161299 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161594 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161754 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161887 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.161983 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162203 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162290 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162513 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162597 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162826 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.162912 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163139 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163230 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163444 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163529 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163751 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.163838 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164064 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164149 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164378 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164469 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164687 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.164781 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165000 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165084 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165304 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165389 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165623 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165710 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.165963 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166052 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166271 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166368 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166577 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166671 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166891 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.166979 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167202 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167368 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167512 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167596 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167826 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.167919 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168139 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168234 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168442 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168526 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168748 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.168834 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169062 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169155 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169369 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169460 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169677 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.169772 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170008 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170097 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170310 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170401 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170630 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170714 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.170948 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171043 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171250 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171334 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171562 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171646 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171882 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.171974 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172195 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172286 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172505 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172597 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172817 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.172950 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173128 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173212 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173439 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173539 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173749 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.173854 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174087 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174207 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174395 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174493 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174703 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.174794 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175009 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175100 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175316 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175409 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175639 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175786 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.175949 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176044 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176261 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176355 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176573 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176659 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176878 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.176962 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.177735 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.177871 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178052 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178150 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178434 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178628 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178765 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.178964 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179087 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179283 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179407 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179607 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179728 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.179932 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180047 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180253 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180366 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180685 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.180915 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181000 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181253 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181347 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181561 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181648 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181896 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.181999 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182210 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182296 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182519 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182606 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182836 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.182923 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.183149 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.183403 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.183488 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.183744 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.183830 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184054 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184137 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184361 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184447 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184669 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184756 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.184975 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185069 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185284 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185370 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185599 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185694 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.185927 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186016 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186254 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186354 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186563 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186662 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.186889 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187020 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187199 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187283 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187507 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187606 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187818 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.187944 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188127 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188225 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188438 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188534 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188756 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.188844 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189067 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189153 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189377 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189465 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189685 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.189778 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190018 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190107 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190339 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190427 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190649 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190742 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.190952 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191037 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191259 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191344 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191564 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191650 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.191878 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.192108 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.192202 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.192279 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.192473 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.192559 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.193395 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.193509 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.193714 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.193873 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194061 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194148 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194380 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194479 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194689 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.194810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195004 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195161 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195315 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195474 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195634 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195785 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.195947 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196115 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196261 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196426 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196567 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196736 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.196882 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197043 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197194 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197359 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197502 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197674 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.197817 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198008 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198147 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198324 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198467 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198639 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198776 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.198954 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199085 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199268 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199390 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199577 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199703 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.199892 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200018 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200202 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200325 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200522 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200649 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200837 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.200964 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201145 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201271 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201459 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201576 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201775 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.201897 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202114 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202210 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202423 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202510 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202739 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.202834 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203048 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203134 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203370 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203464 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203679 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203773 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.203990 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204075 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204294 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204391 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204603 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204690 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204908 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.204993 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205213 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205307 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205513 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205610 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205817 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.205929 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206150 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206250 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206455 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206549 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206761 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.206847 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207198 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207376 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207462 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207682 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207768 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.207987 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.208079 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.208332 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.208525 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.208644 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.208963 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.209079 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.209536 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.209637 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.209865 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.209957 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210182 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210279 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210498 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210586 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210809 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.210896 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211119 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211432 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211519 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211740 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.211827 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212045 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212140 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212364 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212450 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212673 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212764 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.212984 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213071 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213288 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213372 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213589 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213674 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.213934 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214023 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214252 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214341 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214567 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214666 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214890 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.214976 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215207 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215293 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215530 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215623 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215837 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.215929 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216149 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216245 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216462 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216557 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216771 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.216857 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217078 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217162 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217390 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217484 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217702 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.217787 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218037 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218134 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218344 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218441 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218655 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218739 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.218968 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219053 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219275 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219375 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219587 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219675 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219902 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.219990 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220210 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220304 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220518 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220602 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220833 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.220919 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221133 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221219 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221443 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221529 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221751 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.221858 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222086 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222175 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222390 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222475 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222703 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.222818 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223019 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223134 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223334 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223446 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223647 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223746 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.223982 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224105 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224298 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224387 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224612 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224709 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.224923 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225009 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225250 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225338 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225566 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225661 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225903 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.225994 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226221 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226307 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226532 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226621 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226847 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.226942 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227157 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227244 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227469 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227585 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227856 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.227949 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228103 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228186 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228408 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228484 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228713 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.228798 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229035 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229129 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229341 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229428 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229663 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.229748 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230011 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230111 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230408 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230500 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230717 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.230810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231046 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231143 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231371 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231457 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231682 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231808 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.231989 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232084 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232304 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232389 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232633 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232718 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.232936 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233031 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233240 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233326 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233548 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233632 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233891 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.233983 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234203 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234301 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234513 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234599 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234834 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.234943 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235143 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235265 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235468 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235569 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235792 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.235986 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236106 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236303 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236433 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236618 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236850 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.236937 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237175 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237263 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237490 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237576 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237812 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.237960 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238160 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238249 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238467 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238553 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238771 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.238870 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.239083 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.239169 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.239389 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.239474 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.240250 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.240505 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.240601 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.240837 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.240924 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241146 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241242 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241460 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241548 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241775 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.241953 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242115 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242229 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242424 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242559 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242729 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.242876 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243053 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243200 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243357 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243529 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243680 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243841 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.243995 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244150 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244320 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244467 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244645 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244778 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.244952 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245089 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245273 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245418 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245726 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.245914 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.246056 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.246222 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.246370 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.246528 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.246688 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.247777 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.247872 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.247946 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248023 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248100 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248176 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248262 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248341 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248425 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248504 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248583 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248668 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248756 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.248835 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249045 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249133 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249366 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249453 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249688 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.249777 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250051 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250138 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250360 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250458 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250665 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250751 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.250970 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251060 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251276 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251371 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251679 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.251891 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252013 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252205 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252304 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252511 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252599 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252818 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.252918 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253125 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253222 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253449 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253535 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253753 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.253917 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254101 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254190 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254414 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254499 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254722 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.254810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.255026 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.255189 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.255938 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256036 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256257 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256343 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256571 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256658 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256884 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.256970 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257199 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257286 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257511 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257598 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257819 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.257925 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258149 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258248 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258470 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258554 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258774 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.258858 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259091 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259185 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259401 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259486 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259714 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.259802 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260023 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260117 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260327 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260411 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260646 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260730 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.260963 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261056 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261301 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261484 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261618 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261817 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.261972 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262160 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262298 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262479 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262619 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262798 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.262932 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263118 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263243 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263435 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263564 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263751 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.263884 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264067 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264203 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264383 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264518 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264697 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.264839 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.265028 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.265157 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.265354 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.265480 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.265681 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266037 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266128 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266354 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266452 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266671 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266768 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.266992 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267078 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267305 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267389 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267623 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267709 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.267944 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268030 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268256 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268340 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268571 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268658 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268884 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.268968 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269198 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269292 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269508 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269595 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269822 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.269920 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270168 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270332 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270481 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270567 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270843 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.270978 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271166 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271310 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271526 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271669 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271851 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.271991 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272214 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272312 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272536 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272627 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272850 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.272937 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273168 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273256 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273487 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273572 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273806 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.273950 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.274152 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.274453 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.274540 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.274772 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.274857 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275084 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275178 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275400 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275486 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275713 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.275796 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276031 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276120 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276347 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276432 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276671 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276758 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.276976 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277063 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277292 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277378 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277608 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277694 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.277945 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278036 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278250 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278336 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278578 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278779 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.278895 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279099 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279196 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279438 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279533 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279765 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.279853 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280094 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280327 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280413 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280676 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280771 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.280992 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281078 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281320 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281406 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281625 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281713 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.281969 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282061 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282278 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282365 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282583 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282670 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.282899 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283030 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283293 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283512 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283599 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283820 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.283912 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.284127 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.284220 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.284435 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.284661 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.284757 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285016 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285104 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285337 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285426 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285646 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285730 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.285978 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.286066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.286312 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.286462 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.286796 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.286896 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287245 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287331 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287564 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287653 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287882 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.287969 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288192 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288278 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288502 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288591 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288810 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.288896 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289116 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289214 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289429 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289533 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289733 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.289875 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290067 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290166 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290372 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290459 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290686 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290772 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.290989 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291083 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291301 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291387 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291608 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291704 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.291918 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292014 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292224 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292310 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292534 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292625 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292846 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.292934 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293157 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293250 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293468 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293565 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293787 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.293905 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294121 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294208 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294435 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294529 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294747 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.294836 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295286 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295373 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295625 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295724 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.295950 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296036 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296285 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296372 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296597 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296686 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296909 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.296994 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297223 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297309 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297532 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297620 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297879 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.297982 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298200 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298287 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298515 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298602 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298826 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.298927 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.299139 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.299226 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.299454 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.299695 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.299781 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300036 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300125 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300362 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300449 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300672 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300757 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.300984 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301078 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301297 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301426 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301612 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301697 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.301950 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.302579 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.302845 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.302934 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303169 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303263 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303489 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.303898 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304131 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304273 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304448 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304544 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304763 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.304856 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305074 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305160 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305385 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305482 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305697 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.305790 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306034 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306122 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306347 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306446 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306665 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306752 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.306978 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307071 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307288 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307376 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307605 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307698 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.307950 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308036 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308279 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308369 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308603 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308689 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.308926 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309012 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309258 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309437 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309560 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309653 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309892 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.309994 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310208 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310292 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310520 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310606 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310838 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.310931 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311174 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311262 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311494 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311581 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311810 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.311905 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312115 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312235 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312424 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312555 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312731 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.312880 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313045 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313208 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313365 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313526 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313677 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.313874 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314010 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314207 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314341 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314525 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314621 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314852 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.314940 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315168 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315254 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315488 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315575 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315793 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.315879 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316105 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316192 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316409 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316497 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316713 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.316799 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317017 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317102 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317323 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317410 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317713 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.317860 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318071 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318185 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318390 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318483 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318699 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.318786 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319006 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319107 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319321 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319416 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319631 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319718 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.319934 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320030 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320240 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320326 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320549 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320637 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320861 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.320957 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321168 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321261 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321475 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321562 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321788 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.321937 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322120 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322428 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322525 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322801 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.322901 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323049 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323136 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323359 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323494 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323664 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323752 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.323972 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324058 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324280 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324367 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324588 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324684 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324907 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.324993 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325224 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325310 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325538 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325626 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325881 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.325983 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326203 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326300 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326510 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326604 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326831 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.326916 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327151 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327246 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327473 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327558 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327791 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.327877 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328108 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328201 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328442 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328528 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328755 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.328849 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329153 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329380 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329474 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329691 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.329776 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330026 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330114 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330342 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330428 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330654 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330739 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.330972 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331288 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331381 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331605 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331738 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.331934 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332020 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332257 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332341 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332574 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332724 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.332907 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.333004 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.333215 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.333936 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.334354 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.334459 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.334690 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.334815 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335035 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335122 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335366 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335455 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335684 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.335779 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336002 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336089 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336312 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336400 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336559 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:08:21.336647 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.336954 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.337278 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.337613 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.337968 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.338288 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.338620 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.338951 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.339301 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.339623 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.339972 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.340309 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.340630 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.340950 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.341263 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:21.341513 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:08:21.490609 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO dbcounter [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Registered counter for database nova_api Aug 07 01:08:21.495201 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO dbcounter [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Registered counter for database nova_api Aug 07 01:08:21.511742 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.516398 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_db.sqlalchemy.engines [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.518246 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writer thread running {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.523727 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writer thread running {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.574185 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.context [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=103774) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:08:21.578002 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:21.578472 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:21.579447 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.context [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=103773) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:08:21.580013 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:21.580728 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:21.581166 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:21.583157 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:21.583264 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:21.584559 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:21.585968 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO dbcounter [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Registered counter for database nova_cell0 Aug 07 01:08:21.586270 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:21.587015 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:21.587475 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:21.589456 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_concurrency.lockutils [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:21.591327 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO dbcounter [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Registered counter for database nova_cell1 Aug 07 01:08:21.591445 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO dbcounter [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Registered counter for database nova_cell0 Aug 07 01:08:21.596854 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO dbcounter [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Registered counter for database nova_cell1 Aug 07 01:08:21.599032 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.601311 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.603932 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_db.sqlalchemy.engines [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.606743 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writer thread running {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.607735 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_db.sqlalchemy.engines [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.608517 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writer thread running {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.610665 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writer thread running {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.750449 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writer thread running {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.752185 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO dbcounter [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Registered counter for database nova_cell0 Aug 07 01:08:21.759836 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.759998 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO dbcounter [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Registered counter for database nova_cell0 Aug 07 01:08:21.764291 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writer thread running {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:21.768476 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG oslo_db.sqlalchemy.engines [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:21.773520 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writer thread running {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:22.173722 dv-cinder-master-3-smb devstack@n-api.service[103774]: WARNING keystonemiddleware.auth_token [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:22.181477 dv-cinder-master-3-smb devstack@n-api.service[103774]: WARNING keystonemiddleware.auth_token [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:22.211192 dv-cinder-master-3-smb devstack@n-api.service[103773]: WARNING keystonemiddleware.auth_token [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:22.218380 dv-cinder-master-3-smb devstack@n-api.service[103773]: WARNING keystonemiddleware.auth_token [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:22.526469 dv-cinder-master-3-smb devstack@n-api.service[103774]: WARNING keystonemiddleware.auth_token [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:22.532308 dv-cinder-master-3-smb devstack@n-api.service[103774]: WARNING keystonemiddleware.auth_token [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:22.537757 dv-cinder-master-3-smb devstack@n-api.service[103774]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea6e6629c0 pid: 103774 (default app) Aug 07 01:08:22.539830 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:08:22.541001 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 07 01:08:22.541419 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Sun Aug 7 01:08:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:08:22.564428 dv-cinder-master-3-smb devstack@n-api.service[103773]: WARNING keystonemiddleware.auth_token [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:22.571228 dv-cinder-master-3-smb devstack@n-api.service[103773]: WARNING keystonemiddleware.auth_token [None req-6a7878e0-900e-45d5-b7bf-7164927d8883 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:22.576509 dv-cinder-master-3-smb devstack@n-api.service[103773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea6e6629c0 pid: 103773 (default app) Aug 07 01:09:40.580541 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.581536 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 07 01:09:40.582494 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.595120 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_api:SELECT=3 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:40.596220 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_cell1:SELECT=3 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:40.597066 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_cell0:SELECT=3 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:40.599189 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:41.498927 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-e22a34a2-72c0-423d-a971-552fb1a04197 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.536179 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-e22a34a2-72c0-423d-a971-552fb1a04197 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945693 Aug 07 01:09:41.537077 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:43.862019 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:43.863644 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-d5e89352-f0eb-4423-b9ab-89aa6acf704e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 07 01:09:43.869180 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:44.302405 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cf848d92-f4ef-4fc6-9284-86d235e903d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:44.323042 dv-cinder-master-3-smb devstack@n-api.service[103773]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:44.323042 dv-cinder-master-3-smb devstack@n-api.service[103773]: warnings.warn(msg) Aug 07 01:09:44.402074 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cf848d92-f4ef-4fc6-9284-86d235e903d3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.531742 Aug 07 01:09:44.402885 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:09:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:09:44.620257 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-64ffa8fb-9f36-4f99-905f-da0457c10862 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:44.624617 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:44.624617 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:09:44.627207 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_api:SELECT=3 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.628081 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_cell1:SELECT=3 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.629584 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_cell0:SELECT=3 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.630424 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.732544 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-64ffa8fb-9f36-4f99-905f-da0457c10862 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321394 Aug 07 01:09:44.733414 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Aug 7 01:09:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:46.995756 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cf848d92-f4ef-4fc6-9284-86d235e903d3 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:46.996777 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cf848d92-f4ef-4fc6-9284-86d235e903d3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 07 01:09:46.997175 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:47.778890 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-74df174b-8b90-431b-b67e-d105afc3885b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:47.798078 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:47.798078 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:09:47.876966 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-74df174b-8b90-431b-b67e-d105afc3885b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.873478 Aug 07 01:09:47.877743 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:09:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:09:47.890423 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-7dd29b1c-8ea8-4a42-926f-84ed6cd627d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:47.893516 dv-cinder-master-3-smb devstack@n-api.service[103773]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:47.893516 dv-cinder-master-3-smb devstack@n-api.service[103773]: warnings.warn(msg) Aug 07 01:09:47.990310 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-7dd29b1c-8ea8-4a42-926f-84ed6cd627d7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103634 Aug 07 01:09:47.991274 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Aug 7 01:09:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:50.209481 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-74df174b-8b90-431b-b67e-d105afc3885b admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:50.210526 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-74df174b-8b90-431b-b67e-d105afc3885b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Aug 07 01:09:50.210925 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:50.603071 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-bfddbe83-d600-4f8a-a397-fe040e799280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "disk": 10, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:50.675526 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-bfddbe83-d600-4f8a-a397-fe040e799280 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458168 Aug 07 01:09:50.676181 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:09:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:50.688269 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-b7c0da30-b2e7-423c-9a75-73bd3e8b152b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:50.781634 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-b7c0da30-b2e7-423c-9a75-73bd3e8b152b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096968 Aug 07 01:09:50.782256 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Aug 7 01:09:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:53.015880 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-bfddbe83-d600-4f8a-a397-fe040e799280 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:53.017178 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-bfddbe83-d600-4f8a-a397-fe040e799280 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 07 01:09:53.017564 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:53.462218 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-3ae06b7c-c14b-4453-888e-0829aa3b5b26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:53.527953 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-3ae06b7c-c14b-4453-888e-0829aa3b5b26 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504475 Aug 07 01:09:53.528884 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:09:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:09:53.541584 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-2a5ffaaf-f05b-461a-aed7-76c41071306a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:53.605885 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-2a5ffaaf-f05b-461a-aed7-76c41071306a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068002 Aug 07 01:09:53.606704 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Aug 7 01:09:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:55.839099 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-3ae06b7c-c14b-4453-888e-0829aa3b5b26 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:55.840093 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-3ae06b7c-c14b-4453-888e-0829aa3b5b26 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 07 01:09:55.840523 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:56.295656 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:56.373328 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.527023 Aug 07 01:09:56.373931 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:09:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:56.386448 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-ee82a54c-e3f3-4720-97d0-dc6276d62af4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:56.513813 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-ee82a54c-e3f3-4720-97d0-dc6276d62af4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131018 Aug 07 01:09:56.514670 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Aug 7 01:09:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:58.742238 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:58.743892 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002391 Aug 07 01:09:58.744505 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:59.149990 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-6531fb70-1e7e-44b2-a9ee-eada65d4e3ec admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.176212 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-6531fb70-1e7e-44b2-a9ee-eada65d4e3ec admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.422672 Aug 07 01:09:59.176904 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:10:01.632503 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:01.633560 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-b7892ec9-a7b7-4a9e-a378-5ed4a7cab80d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 07 01:10:01.634084 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:02.103365 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-61cdd90e-f5be-467e-949c-82c8cf0fe942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "disk": 1, "id": "1"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:02.178427 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-61cdd90e-f5be-467e-949c-82c8cf0fe942 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.538328 Aug 07 01:10:02.178976 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:10:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:02.193459 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-1a1cb395-ea92-4bd3-a0ab-a5af60d5440b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:02.274780 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-1a1cb395-ea92-4bd3-a0ab-a5af60d5440b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085980 Aug 07 01:10:02.275501 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Aug 7 01:10:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:04.544988 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-61cdd90e-f5be-467e-949c-82c8cf0fe942 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:04.546115 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-61cdd90e-f5be-467e-949c-82c8cf0fe942 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 07 01:10:04.546518 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:04.947939 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-42719568-c459-4858-b7e1-c37d76408bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:05.024324 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-42719568-c459-4858-b7e1-c37d76408bda admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470962 Aug 07 01:10:05.025118 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:10:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:10:05.037609 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-45b4fcf0-9f38-4a26-9484-631c3aa436a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:05.147922 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-45b4fcf0-9f38-4a26-9484-631c3aa436a1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114417 Aug 07 01:10:05.148500 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Aug 7 01:10:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:07.362741 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-42719568-c459-4858-b7e1-c37d76408bda admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:07.363751 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-42719568-c459-4858-b7e1-c37d76408bda admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 07 01:10:07.364156 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:07.722001 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-a16f127a-ecfa-447b-9d9c-d17590631b14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:07.795473 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-a16f127a-ecfa-447b-9d9c-d17590631b14 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425186 Aug 07 01:10:07.796029 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:10:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:07.808976 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-f17a65d3-c45f-481d-be20-c15a93cdb966 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:07.900871 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-f17a65d3-c45f-481d-be20-c15a93cdb966 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095505 Aug 07 01:10:07.901446 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Aug 7 01:10:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:10.191241 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-a16f127a-ecfa-447b-9d9c-d17590631b14 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:10.192352 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-a16f127a-ecfa-447b-9d9c-d17590631b14 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Aug 07 01:10:10.192843 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:10.641520 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-ed278c97-cc85-4386-bf1a-391d4cea97f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:10.717157 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:10.724681 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-ed278c97-cc85-4386-bf1a-391d4cea97f6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525762 Aug 07 01:10:10.725406 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:10:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:10.737901 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-b34e360c-a4d0-4058-8090-1992e9624d96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:10.828377 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-b34e360c-a4d0-4058-8090-1992e9624d96 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094751 Aug 07 01:10:10.829236 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Aug 7 01:10:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:13.049219 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-ed278c97-cc85-4386-bf1a-391d4cea97f6 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:13.050842 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-ed278c97-cc85-4386-bf1a-391d4cea97f6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002585 Aug 07 01:10:13.051710 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:13.493998 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge"}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:13.577134 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519522 Aug 07 01:10:13.578680 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Aug 7 01:10:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:13.593723 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-0d91e336-f34a-424b-95ca-3b6807862feb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:13.698092 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-0d91e336-f34a-424b-95ca-3b6807862feb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107972 Aug 07 01:10:13.698616 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Aug 7 01:10:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:34.214636 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:34.215901 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Aug 07 01:10:34.216300 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:34.598745 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-3113880b-074c-4338-a4fc-2bc5973c3ae5 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:34.616827 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-3113880b-074c-4338-a4fc-2bc5973c3ae5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393751 Aug 07 01:10:34.617368 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Aug 7 01:10:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:35.670443 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:35.671471 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-647e4414-33ef-41df-a4ee-ac6a03a7612a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 07 01:10:35.671888 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:36.186412 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-f20dea3a-4b1b-452f-8cfc-74e1ba8a1dd5 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:36.192662 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.wsgi [None req-f20dea3a-4b1b-452f-8cfc-74e1ba8a1dd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-f20dea3a-4b1b-452f-8cfc-74e1ba8a1dd5 admin admin] Request method failure captured: Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept: application/json Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept-Encoding: gzip, deflate Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Connection: keep-alive Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Content-Length: 0 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Host: 10.222.0.36 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-System-Scope: None Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: User-Agent: python-novaclient Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Auth-Token: gAAAAABi7xELqVgFBehOqUCG8vOqozEV_8ucx6Qu34w3ibmHtik4gsvUF7fXFRu6SJRhDETj-a0TZhr3CKd0NmB9I-LD1nxhFCU-iX7KM9paq92IJuMjYPJ2GtNwMJJ3XxsKyCxmELy_awOmFSrnqd7tCuQlHmnZ1rCn-tkM9rFOVv8bHo-g1bs Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Id: None Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Name: None Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Identity-Status: Confirmed Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Is-Admin-Project: True Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Id: default Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Name: Default Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Name: admin Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Role: admin,reader,member Aug 07 01:10:36.195956 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Roles: admin,reader,member Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant: admin Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Name: admin Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User: admin Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Id: default Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Name: Default Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Name: admin Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: method: > Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: exception: Flavor 42 could not be found. Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: action_args: {'id': '42'} Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:36.197581 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:36.198634 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.200120 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-f20dea3a-4b1b-452f-8cfc-74e1ba8a1dd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:36.201378 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-f20dea3a-4b1b-452f-8cfc-74e1ba8a1dd5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390339 Aug 07 01:10:36.201378 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Aug 7 01:10:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:36.207896 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-04ecc2ef-23e8-4793-8ba1-1d134690bcb1 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:36.212292 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:36.230875 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-04ecc2ef-23e8-4793-8ba1-1d134690bcb1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026809 Aug 07 01:10:36.231422 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:10:36.241689 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-206b8d27-bbf7-4728-9e02-7f532e8ef74b admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:36.265875 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-206b8d27-bbf7-4728-9e02-7f532e8ef74b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027739 Aug 07 01:10:36.266403 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:36.276024 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-8a8be3e8-da39-43dd-b7b5-13ab9eca2056 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:36.281705 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.wsgi [None req-8a8be3e8-da39-43dd-b7b5-13ab9eca2056 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-8a8be3e8-da39-43dd-b7b5-13ab9eca2056 admin admin] Request method failure captured: Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept: application/json Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept-Encoding: gzip, deflate Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Connection: keep-alive Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Content-Length: 0 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Host: 10.222.0.36 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-System-Scope: None Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: User-Agent: python-novaclient Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Auth-Token: gAAAAABi7xELqVgFBehOqUCG8vOqozEV_8ucx6Qu34w3ibmHtik4gsvUF7fXFRu6SJRhDETj-a0TZhr3CKd0NmB9I-LD1nxhFCU-iX7KM9paq92IJuMjYPJ2GtNwMJJ3XxsKyCxmELy_awOmFSrnqd7tCuQlHmnZ1rCn-tkM9rFOVv8bHo-g1bs Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Id: None Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Name: None Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Identity-Status: Confirmed Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Is-Admin-Project: True Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Id: default Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Name: Default Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Name: admin Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Role: admin,reader,member Aug 07 01:10:36.285299 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Roles: admin,reader,member Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant: admin Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Name: admin Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User: admin Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Id: default Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Name: Default Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Name: admin Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: method: > Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: exception: Flavor 42 could not be found. Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: action_args: {'id': '42'} Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:36.288886 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:36.289871 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:36.291134 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-8a8be3e8-da39-43dd-b7b5-13ab9eca2056 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:36.292417 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-8a8be3e8-da39-43dd-b7b5-13ab9eca2056 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014560 Aug 07 01:10:36.292417 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Aug 7 01:10:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:37.255440 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-206b8d27-bbf7-4728-9e02-7f532e8ef74b admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.256449 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-206b8d27-bbf7-4728-9e02-7f532e8ef74b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 07 01:10:37.256851 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:37.770751 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-fdc31c8c-1bfe-4022-b5dd-ef40f0a1a55d admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.775980 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.wsgi [None req-fdc31c8c-1bfe-4022-b5dd-ef40f0a1a55d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-fdc31c8c-1bfe-4022-b5dd-ef40f0a1a55d admin admin] Request method failure captured: Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept: application/json Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept-Encoding: gzip, deflate Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Connection: keep-alive Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Content-Length: 0 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Host: 10.222.0.36 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-System-Scope: None Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: User-Agent: python-novaclient Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Auth-Token: gAAAAABi7xENCZwmdt837YYv8BKTlNyBsM-kRWhVv2qETXlFZ0YASeNVgyfFELC6DUV0TmjI7kXJBD79NBi-6sl71Lok9kpsOkm7_6Xmw7OZ6V2ZMVJZh-xr_kfdjdL9z-3fbhMXZQKfTIoiOsbLgWOR3w2AePHATbQXTMOm79gyhYDBGg7f-rc Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Id: None Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Name: None Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Identity-Status: Confirmed Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Is-Admin-Project: True Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Id: default Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Name: Default Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Name: admin Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Role: admin,reader,member Aug 07 01:10:37.777453 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Roles: admin,reader,member Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant: admin Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Name: admin Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User: admin Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Id: default Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Name: Default Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Name: admin Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: method: > Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: exception: Flavor 84 could not be found. Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: action_args: {'id': '84'} Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:37.779086 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:37.779892 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.781028 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-fdc31c8c-1bfe-4022-b5dd-ef40f0a1a55d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:37.782064 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-fdc31c8c-1bfe-4022-b5dd-ef40f0a1a55d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384432 Aug 07 01:10:37.782064 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:37.789200 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-c8606cf0-76a3-45d8-8f9b-39496718545d admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.804103 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-c8606cf0-76a3-45d8-8f9b-39496718545d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018467 Aug 07 01:10:37.804566 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:37.813888 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-1a571850-02d7-4587-b01a-ad3bbc92c088 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.830682 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-1a571850-02d7-4587-b01a-ad3bbc92c088 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019710 Aug 07 01:10:37.831204 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:37.840689 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-3be43f81-7f43-4155-96ce-3d496b7f99f2 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.846520 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.wsgi [None req-3be43f81-7f43-4155-96ce-3d496b7f99f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-3be43f81-7f43-4155-96ce-3d496b7f99f2 admin admin] Request method failure captured: Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept: application/json Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept-Encoding: gzip, deflate Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Connection: keep-alive Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Content-Length: 0 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Host: 10.222.0.36 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-System-Scope: None Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: User-Agent: python-novaclient Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Auth-Token: gAAAAABi7xENCZwmdt837YYv8BKTlNyBsM-kRWhVv2qETXlFZ0YASeNVgyfFELC6DUV0TmjI7kXJBD79NBi-6sl71Lok9kpsOkm7_6Xmw7OZ6V2ZMVJZh-xr_kfdjdL9z-3fbhMXZQKfTIoiOsbLgWOR3w2AePHATbQXTMOm79gyhYDBGg7f-rc Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Id: None Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Name: None Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Identity-Status: Confirmed Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Is-Admin-Project: True Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Id: default Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Name: Default Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Name: admin Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Role: admin,reader,member Aug 07 01:10:37.848002 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Roles: admin,reader,member Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant: admin Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Name: admin Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User: admin Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Id: default Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Name: Default Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Name: admin Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: method: > Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: exception: Flavor 84 could not be found. Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: action_args: {'id': '84'} Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:37.849432 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:37.850282 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:37.851431 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-3be43f81-7f43-4155-96ce-3d496b7f99f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:37.852419 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-3be43f81-7f43-4155-96ce-3d496b7f99f2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012139 Aug 07 01:10:37.852419 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:38.811703 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-1a571850-02d7-4587-b01a-ad3bbc92c088 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:38.812700 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-1a571850-02d7-4587-b01a-ad3bbc92c088 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 07 01:10:38.813096 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:39.335753 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-8e7df44d-6ae1-4a5c-8f4c-d7581450d3d4 admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:39.341428 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.wsgi [None req-8e7df44d-6ae1-4a5c-8f4c-d7581450d3d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-8e7df44d-6ae1-4a5c-8f4c-d7581450d3d4 admin admin] Request method failure captured: Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept: application/json Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Accept-Encoding: gzip, deflate Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Connection: keep-alive Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Content-Length: 0 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Host: 10.222.0.36 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: Openstack-System-Scope: None Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: User-Agent: python-novaclient Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Auth-Token: gAAAAABi7xEO0LkBQ6J6U2FmHn3VUpPdJleALLgxKJjVJEprpAeOAxGCzJ13yejgXFbr7Uj9L1ZtIpiiaULLWDL17I2TrV_Sc4gbmbGJEnu6fpI2F-cHBMvRp6Ne82PGNojjTOKqrhOxsyeaVEh4TXrn7GyXA9COSPANI_i9qlX9UN6NEvphzFo Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Id: None Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Domain-Name: None Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Identity-Status: Confirmed Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Is-Admin-Project: True Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Id: default Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Domain-Name: Default Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Project-Name: admin Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Role: admin,reader,member Aug 07 01:10:39.342967 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Roles: admin,reader,member Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant: admin Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-Tenant-Name: admin Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User: admin Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Id: default Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Domain-Name: Default Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: X-User-Name: admin Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: method: > Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: exception: Flavor 451 could not be found. Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: action_args: {'id': '451'} Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:39.344319 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:39.345399 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.346823 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-8e7df44d-6ae1-4a5c-8f4c-d7581450d3d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:39.348060 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-8e7df44d-6ae1-4a5c-8f4c-d7581450d3d4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393809 Aug 07 01:10:39.348060 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:10:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:39.354274 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-8e52646a-b0f6-4f33-843e-2ba26d37c8a2 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:39.370538 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-8e52646a-b0f6-4f33-843e-2ba26d37c8a2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019820 Aug 07 01:10:39.371072 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:39.381272 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:39.396366 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019313 Aug 07 01:10:39.404266 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Aug 7 01:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:10:39.413372 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-9f478de5-d6a6-4168-bdd4-c58ad0badcba admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:39.418956 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.wsgi [None req-9f478de5-d6a6-4168-bdd4-c58ad0badcba admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-9f478de5-d6a6-4168-bdd4-c58ad0badcba admin admin] Request method failure captured: Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept: application/json Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Accept-Encoding: gzip, deflate Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Connection: keep-alive Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Content-Length: 0 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Host: 10.222.0.36 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-Api-Version: compute 2.90 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: Openstack-System-Scope: None Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: User-Agent: python-novaclient Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Auth-Token: gAAAAABi7xEO0LkBQ6J6U2FmHn3VUpPdJleALLgxKJjVJEprpAeOAxGCzJ13yejgXFbr7Uj9L1ZtIpiiaULLWDL17I2TrV_Sc4gbmbGJEnu6fpI2F-cHBMvRp6Ne82PGNojjTOKqrhOxsyeaVEh4TXrn7GyXA9COSPANI_i9qlX9UN6NEvphzFo Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Id: None Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Domain-Name: None Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Identity-Status: Confirmed Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Is-Admin-Project: True Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Id: default Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Domain-Name: Default Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Project-Name: admin Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Role: admin,reader,member Aug 07 01:10:39.420524 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Roles: admin,reader,member Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d8f722b65514efcbdc7ef3dc7a594c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d8f722b65514efcbdc7ef3dc7a594c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant: admin Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Id: 4d8f722b65514efcbdc7ef3dc7a594c9 Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-Tenant-Name: admin Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User: admin Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Id: default Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Domain-Name: Default Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Id: a7ab3d54af314822bc2df0049ba7e2fb Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: X-User-Name: admin Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: method: > Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: exception: Flavor 451 could not be found. Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: action_args: {'id': '451'} Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:39.422101 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:39.423055 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: ERROR nova.api.openstack.wsgi Aug 07 01:10:39.424245 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-9f478de5-d6a6-4168-bdd4-c58ad0badcba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:39.425270 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-9f478de5-d6a6-4168-bdd4-c58ad0badcba admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012325 Aug 07 01:10:39.425270 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:10:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:40.387703 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:40.388708 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 07 01:10:40.389101 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:40.904067 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-e3fd9ebe-bd43-4774-8681-c80125d967e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:40.971480 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-e3fd9ebe-bd43-4774-8681-c80125d967e2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.444152 Aug 07 01:10:40.972029 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Aug 7 01:10:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:41.942159 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:41.943227 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 07 01:10:41.943626 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:42.461241 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-d3621f99-7de8-4c72-b39b-5581408b9f49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:42.530298 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-d3621f99-7de8-4c72-b39b-5581408b9f49 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.448683 Aug 07 01:10:42.530847 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Aug 7 01:10:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:43.490585 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:43.491609 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 07 01:10:43.492160 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:44.034317 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-0c221b7d-b95b-476b-bec4-ad813ed43931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:44.137514 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-0c221b7d-b95b-476b-bec4-ad813ed43931 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.504697 Aug 07 01:10:44.138136 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Aug 7 01:10:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:45.155286 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:45.156296 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 07 01:10:45.156699 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:45.673710 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-730262bf-5507-4ff6-b3fd-61675ac648d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:45.736862 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-730262bf-5507-4ff6-b3fd-61675ac648d3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.440939 Aug 07 01:10:45.737404 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Aug 7 01:10:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:46.705344 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:46.706419 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Aug 07 01:10:46.706800 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:47.227407 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-6e1cdc30-7a5b-44ab-9439-85b186a94d53 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:47.248256 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-6e1cdc30-7a5b-44ab-9439-85b186a94d53 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401031 Aug 07 01:10:47.248731 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Sun Aug 7 01:10:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:38.432135 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.433146 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-cc3c4fa0-9cb0-4454-b46a-211019bb9cae admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 07 01:11:38.433548 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:38.444234 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.821115 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-efd059a8-700f-4223-a496-ff545831d700 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.842162 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-efd059a8-700f-4223-a496-ff545831d700 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402121 Aug 07 01:11:38.842680 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:38.865709 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-20445de3-841b-4b09-b5fc-1d2e643cac3f admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.869212 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG dbcounter [-] [103773] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.874692 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-20445de3-841b-4b09-b5fc-1d2e643cac3f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012709 Aug 07 01:11:38.875231 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:38.886650 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-33e9439f-1521-4d18-aad1-94a0d9a0f5aa admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.894896 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-33e9439f-1521-4d18-aad1-94a0d9a0f5aa admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011754 Aug 07 01:11:38.895417 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:38.906804 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.914752 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011496 Aug 07 01:11:38.915316 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:38.926307 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-104b1e26-5df9-4748-82d6-9324b94c361d admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:38.933804 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-104b1e26-5df9-4748-82d6-9324b94c361d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010939 Aug 07 01:11:38.934352 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Sun Aug 7 01:11:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:49.184978 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:49.186029 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 07 01:14:49.186426 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:49.327468 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_api:SELECT=6 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:49.483719 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:49.486132 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:14:49.486132 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:14:49.487239 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.487731 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.488178 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.488875 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.489316 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.489724 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.523671 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-89fc755c-7606-479b-a4c7-94ceedefc7e1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.197613 Aug 07 01:14:49.524255 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:14:49 2022] GET /compute/v2.1/os-services => generated 785 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:14:50.353749 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.355278 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Aug 07 01:14:50.355677 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:50.547242 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.549613 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:14:50.549613 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:14:50.550736 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.551205 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.551629 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.552323 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.552762 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.553171 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.573524 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-14dad09b-d4e2-4b26-ad6c-351d155ec4a0 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.076738 Aug 07 01:14:50.574047 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1/os-services => generated 785 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:15:01.816199 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:01.817201 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 07 01:15:01.817591 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:15:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:15:01.963982 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_cell0:SELECT=4 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:01.964585 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_cell1:SELECT=4 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:01.965187 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG dbcounter [-] [103774] Writing DB stats nova_api:SELECT=8 {{(pid=103774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:02.013988 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:02.016480 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:02.016480 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:15:02.017560 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.018058 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.018480 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.019267 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.019719 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.020129 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.046530 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-52a19b0b-2062-4764-af50-bf95ec358229 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.087609 Aug 07 01:15:02.047077 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:15:01 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:15:02.883910 dv-cinder-master-3-smb devstack@n-api.service[103773]: DEBUG nova.api.openstack.wsgi [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] Calling method '>' {{(pid=103773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:02.884919 dv-cinder-master-3-smb devstack@n-api.service[103773]: INFO nova.api.openstack.requestlog [None req-91f7949b-c358-40af-b18d-54b1c8beeceb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 07 01:15:02.885316 dv-cinder-master-3-smb devstack@n-api.service[103773]: [pid: 103773|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Aug 7 01:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:03.076451 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG nova.api.openstack.wsgi [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Calling method '>' {{(pid=103774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.078927 dv-cinder-master-3-smb devstack@n-api.service[103774]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:03.078927 dv-cinder-master-3-smb devstack@n-api.service[103774]: warnings.warn(msg) Aug 07 01:15:03.080286 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.080783 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.081329 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.082107 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.082555 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.082972 dv-cinder-master-3-smb devstack@n-api.service[103774]: DEBUG oslo_concurrency.lockutils [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.104893 dv-cinder-master-3-smb devstack@n-api.service[103774]: INFO nova.api.openstack.requestlog [None req-6c4c5ef1-3457-4b26-a18e-0ff49a8729fa admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.080413 Aug 07 01:15:03.105443 dv-cinder-master-3-smb devstack@n-api.service[103774]: [pid: 103774|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:16:10.216733 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 01:16:10.217254 dv-cinder-master-3-smb devstack@n-api.service[103772]: Sun Aug 7 01:16:10 2022 - graceful shutdown triggered... Aug 07 01:16:10.217685 dv-cinder-master-3-smb devstack@n-api.service[103774]: Gracefully killing worker 2 (pid: 103774)... Aug 07 01:16:10.218097 dv-cinder-master-3-smb devstack@n-api.service[103773]: Gracefully killing worker 1 (pid: 103773)... Aug 07 01:16:11.218066 dv-cinder-master-3-smb devstack@n-api.service[103772]: worker 1 buried after 1 seconds Aug 07 01:16:11.218563 dv-cinder-master-3-smb devstack@n-api.service[103772]: worker 2 buried after 1 seconds Aug 07 01:16:11.218563 dv-cinder-master-3-smb devstack@n-api.service[103772]: goodbye to uWSGI. Aug 07 01:16:11.219635 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 07 01:16:11.220185 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 01:16:11.222984 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 01:16:11.233421 dv-cinder-master-3-smb devstack@n-api.service[118289]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 01:16:11 2022] *** Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: nodename: dv-cinder-master-3-smb Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: machine: x86_64 Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: clock source: unix Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: pcre jit disabled Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: detected number of CPU cores: 4 Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: current working directory: / Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: detected binary path: /usr/bin/uwsgi-core Aug 07 01:16:11.235360 dv-cinder-master-3-smb devstack@n-api.service[118289]: your processes number limit is 47680 Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: your memory page size is 4096 bytes Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: detected max file descriptor number: 2048 Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: lock engine: pthread robust mutexes Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: thunder lock: enabled Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 01:16:11.236120 dv-cinder-master-3-smb devstack@n-api.service[118289]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 01:16:11.276713 dv-cinder-master-3-smb devstack@n-api.service[118289]: Python main interpreter initialized at 0x556af21409c0 Aug 07 01:16:11.276713 dv-cinder-master-3-smb devstack@n-api.service[118289]: python threads support enabled Aug 07 01:16:11.276713 dv-cinder-master-3-smb devstack@n-api.service[118289]: your server socket listen backlog is limited to 100 connections Aug 07 01:16:11.276713 dv-cinder-master-3-smb devstack@n-api.service[118289]: your mercy for graceful operations on workers is 90 seconds Aug 07 01:16:11.277184 dv-cinder-master-3-smb devstack@n-api.service[118289]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 01:16:11.277184 dv-cinder-master-3-smb devstack@n-api.service[118289]: *** Operational MODE: preforking *** Aug 07 01:16:11.277422 dv-cinder-master-3-smb devstack@n-api.service[118289]: *** uWSGI is running in multiple interpreter mode *** Aug 07 01:16:11.277422 dv-cinder-master-3-smb devstack@n-api.service[118289]: spawned uWSGI master process (pid: 118289) Aug 07 01:16:11.277627 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 07 01:16:11.278258 dv-cinder-master-3-smb devstack@n-api.service[118289]: spawned uWSGI worker 1 (pid: 118307, cores: 1) Aug 07 01:16:11.278850 dv-cinder-master-3-smb devstack@n-api.service[118289]: spawned uWSGI worker 2 (pid: 118310, cores: 1) Aug 07 01:16:11.279194 dv-cinder-master-3-smb devstack@n-api.service[118289]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 01:16:11.950030 dv-cinder-master-3-smb devstack@n-api.service[118310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:16:11.950651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:16:13.109520 dv-cinder-master-3-smb devstack@n-api.service[118307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:16:13.109520 dv-cinder-master-3-smb devstack@n-api.service[118307]: from cryptography.utils import int_from_bytes Aug 07 01:16:13.110254 dv-cinder-master-3-smb devstack@n-api.service[118310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:16:13.110254 dv-cinder-master-3-smb devstack@n-api.service[118310]: from cryptography.utils import int_from_bytes Aug 07 01:16:13.110642 dv-cinder-master-3-smb devstack@n-api.service[118307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:16:13.110642 dv-cinder-master-3-smb devstack@n-api.service[118307]: from cryptography.utils import int_from_bytes Aug 07 01:16:13.110764 dv-cinder-master-3-smb devstack@n-api.service[118310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:16:13.110764 dv-cinder-master-3-smb devstack@n-api.service[118310]: from cryptography.utils import int_from_bytes Aug 07 01:16:15.471038 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:16:15.471750 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:16:15.472110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:16:15.472190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:16:15.472299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:16:15.472384 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:16:15.472462 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:16:15.472538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:16:15.472616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:16:15.472713 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:16:15.473294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.473788 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474076 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474720 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.474825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.475933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.476865 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.477013 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.477154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.477318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.477466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.477646 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.478375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.478522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.478822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.478914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.479089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.479267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.479413 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.480914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.481197 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.481442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.481664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.481894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.482103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.482343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.482586 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.482799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.483012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.483215 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.483439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.483680 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.483905 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.484110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.484323 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.484526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.484739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.484961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.485165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.485388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.485592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.485802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.486316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.486533 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.486701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.486850 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.487037 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.487190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.487478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.487685 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489048 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.489823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.490005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.490160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.490311 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.490459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491176 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491864 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.491934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492011 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492397 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492767 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492927 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.492999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.493074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.493144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.493218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.493340 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.493340 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494533 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.494932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495601 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495746 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495830 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495901 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.495968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496259 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496336 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496647 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496725 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496884 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.496960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497197 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497264 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.497928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498238 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498386 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498684 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.498973 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.499861 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500009 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.500869 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.501965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502402 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.502982 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503415 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.503862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504316 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504594 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.504881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505458 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505756 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.505928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506087 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506666 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506814 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.506956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507393 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507830 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.507984 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508725 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.508874 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509297 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.509753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510437 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510737 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.510885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511684 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511830 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.511971 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512418 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.512862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513160 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513622 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.513955 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514135 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514292 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.514861 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515009 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515462 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515611 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515761 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.515902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.516782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:16:15.516922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.517805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518165 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518614 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.518893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519621 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519767 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.519922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.520958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521585 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.521901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522197 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522616 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.522936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523078 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523511 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523824 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.523964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.524103 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.524250 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.524405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.524569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.524882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525233 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.525913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526220 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526369 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526664 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.526993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527142 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527465 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527760 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.527932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.528327 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.528488 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.528637 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.528794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.528936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529077 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529672 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.529811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530071 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530214 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530516 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.530959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531740 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.531879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532323 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532470 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.532959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533260 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.533876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534455 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534749 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.534899 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535205 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535346 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535495 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.535932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536727 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.536867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.537940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538239 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538380 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538662 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.538972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.539999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.540713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.540938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.541186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.541186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.541698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.541943 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.542167 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.542371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.542585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.542808 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.543988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544605 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544767 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.544916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545208 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.545845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546329 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546484 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546795 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.546949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547452 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547569 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547691 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547807 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.547917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548032 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548378 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548487 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548722 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548830 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.548946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.549055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.549336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.549458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.549581 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.555780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.556660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.556856 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557156 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.557948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.558885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.559919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560626 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.560938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.561086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.561253 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.561611 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.561768 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562205 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562364 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562533 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562692 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562841 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.562987 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563134 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563440 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.563909 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564521 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.564978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.565137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.565338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.565504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.565660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.565817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566271 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.566896 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567785 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.567933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.568860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569022 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569774 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.569967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570594 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570758 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.570923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.571072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.571219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.571373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.571772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.571936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.572189 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.572353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.572503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.572650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.572797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573358 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573803 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.573992 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574298 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.574912 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575365 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.575981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576478 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576827 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576911 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.576992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577171 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577344 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577517 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577689 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577882 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.577980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578592 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.578965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579232 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579549 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579736 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.579988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580346 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580452 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580902 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.580985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581495 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.581680 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.582898 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583795 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.583948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584382 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584464 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584912 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.584986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585578 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.585936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586087 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586157 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586406 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.586989 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587275 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587605 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.587989 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588599 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.588906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589418 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589763 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.589880 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.590842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591662 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.591978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592116 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592338 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592503 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592640 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.592892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.593001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.593174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.593487 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.593821 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.594863 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595047 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.595971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.596252 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.596543 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.596695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.596832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.596994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597619 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.597936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.598285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.598394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.598558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.598832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.599154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.599363 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.599487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.599921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.600932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.601099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.601259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.601431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.601580 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.601765 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.602029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.602186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.602447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.602646 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.603445 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.603589 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.603752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604143 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604387 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604477 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.604875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605029 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605345 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605442 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605664 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.605762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606435 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.606977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607601 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.607916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608007 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608328 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608634 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608854 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.608943 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.609164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.609262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.609472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.609590 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.609781 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610064 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610163 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.610819 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611338 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611454 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611686 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.611995 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.612162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.612362 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.612675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.612786 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.612994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.613102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.613321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.613422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.613639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.613737 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614429 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614740 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.614961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615277 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615381 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.615902 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616209 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.616927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617236 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617396 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617692 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.617980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.618154 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.618416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619599 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.619917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620236 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620343 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.620956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621597 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.621947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622150 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.622926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.623880 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624367 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624512 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624828 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.624986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.625141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.625299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.625459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.625608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.625770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626709 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.626895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627316 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.627950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.628983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629616 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.629956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630290 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630849 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.630953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631163 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631473 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631780 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.631885 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632176 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632514 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.632882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633146 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633769 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.633905 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.634964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635506 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.635957 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636793 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.636940 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637256 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637751 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.637929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638092 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638250 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638583 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638720 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.638917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639048 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639237 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639686 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.639869 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.640011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641504 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641880 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.641968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642709 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.642917 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643332 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643663 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.643977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.644904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645417 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645733 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.645825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646160 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646382 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.646795 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647326 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647640 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.647965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648583 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648890 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.648989 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.649199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.649305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.649523 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.649648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.649880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650279 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650630 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650817 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.650965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651828 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.651920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.652169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.652263 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.652509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.652612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.652849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653159 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653289 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653610 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653777 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.653964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.654940 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655256 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655349 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.655888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656510 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.656938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657147 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657765 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.657961 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.658935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659566 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.659879 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.660848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661015 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661855 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.661978 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.662189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.662280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.662515 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.662625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.662903 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663037 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663781 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.663907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.664112 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.664315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.664741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.664850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.664938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.665055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.665718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.665985 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.666082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.666357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.666460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.666681 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.666950 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667295 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667401 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.667940 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668263 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668362 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668586 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.668997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.669228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.669327 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.669543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.669640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.669881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670532 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.670947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671154 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671469 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.671888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672102 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.672822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673387 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.673994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.674177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.674325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.674568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.674674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.674900 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675002 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675329 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.675956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.676178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.676277 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.676495 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.676606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.676866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677022 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677676 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.677878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678360 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678679 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.678996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679183 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679828 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.679928 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.680236 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.680354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.680547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.680678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.681497 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.681601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.681913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.682927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.683027 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.683243 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.683391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.683701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.683805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684073 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684395 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684496 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.684808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685139 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.685761 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686334 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686426 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.686965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687535 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687869 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.687976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688585 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.688906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689535 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.689958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690386 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.690794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691098 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.691920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692843 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.692948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693282 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693761 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.693913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694107 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694419 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.694826 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695344 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695749 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.695967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696365 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.696948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.697167 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.697274 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.697479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.697578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.697901 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698722 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.698812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.699821 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700068 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700697 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.700867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.701929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702041 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702253 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702345 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.702972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.703455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.703585 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.703771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.703927 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.704812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705750 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.705982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706076 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706401 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.706936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707028 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.707885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708277 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708592 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.708935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709435 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.709974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710418 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.710855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711079 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711403 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711534 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711720 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.711832 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712485 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.712798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713327 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713639 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.713996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714097 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714429 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.714994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715304 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715395 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715614 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715720 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.715917 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716011 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.716955 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.717168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.717259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.717476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.717786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718700 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.718805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719315 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719766 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.719913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720523 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.720927 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721177 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721440 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721742 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.721863 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722171 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722373 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.722983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723098 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723382 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.723906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724029 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.724950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725455 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725766 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.725919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726406 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726506 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.726808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.727042 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.727134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.727358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.727458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728791 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.728999 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729162 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.729952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.730907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731124 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.731861 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732090 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.732827 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733344 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.733900 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734092 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734298 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734393 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.734928 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735030 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735339 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.735892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736201 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736516 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.736926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737249 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737464 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737568 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737784 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.737908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738128 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738232 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738443 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738545 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.738854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.739061 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.739154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.739306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:16:15.739398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.739714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.740033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.740367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.740701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.741054 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.741372 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.741724 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.742082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.742405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.742722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.743034 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:16:15.743283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:16:15.893774 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO dbcounter [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Registered counter for database nova_api Aug 07 01:16:15.899466 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO dbcounter [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Registered counter for database nova_api Aug 07 01:16:15.913754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:15.919305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_db.sqlalchemy.engines [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:15.920802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:15.925825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writer thread running {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:15.979116 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.context [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=118307) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:16:15.982825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.983304 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.984168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.context [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=118310) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:16:15.984900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.985632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.986107 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.988108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.988213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.988679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.990154 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO dbcounter [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Registered counter for database nova_cell0 Aug 07 01:16:15.990352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.991130 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.991544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.994506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.995102 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO dbcounter [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Registered counter for database nova_cell1 Aug 07 01:16:15.996682 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO dbcounter [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Registered counter for database nova_cell0 Aug 07 01:16:16.000849 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO dbcounter [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Registered counter for database nova_cell1 Aug 07 01:16:16.004251 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.005411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.008257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_db.sqlalchemy.engines [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.010829 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_db.sqlalchemy.engines [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.013011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.014333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.016410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writer thread running {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.019072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writer thread running {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.161391 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO dbcounter [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Registered counter for database nova_cell0 Aug 07 01:16:16.167404 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO dbcounter [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Registered counter for database nova_cell0 Aug 07 01:16:16.169112 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.174260 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_db.sqlalchemy.engines [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:16:16.174451 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.182026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writer thread running {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:16:16.497558 dv-cinder-master-3-smb devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:16:16.504888 dv-cinder-master-3-smb devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:16:16.515358 dv-cinder-master-3-smb devstack@n-api.service[118310]: WARNING keystonemiddleware.auth_token [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:16:16.523065 dv-cinder-master-3-smb devstack@n-api.service[118310]: WARNING keystonemiddleware.auth_token [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:16:16.858603 dv-cinder-master-3-smb devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:16:16.864600 dv-cinder-master-3-smb devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-a2476b7a-7489-4460-ab94-c6f3b9b4764a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:16:16.870860 dv-cinder-master-3-smb devstack@n-api.service[118307]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556af21409c0 pid: 118307 (default app) Aug 07 01:16:16.883150 dv-cinder-master-3-smb devstack@n-api.service[118310]: WARNING keystonemiddleware.auth_token [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:16:16.889557 dv-cinder-master-3-smb devstack@n-api.service[118310]: WARNING keystonemiddleware.auth_token [None req-cb3e9956-aa12-4dfe-aae3-43a4edbfc5a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:16:16.895867 dv-cinder-master-3-smb devstack@n-api.service[118310]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556af21409c0 pid: 118310 (default app) Aug 07 01:16:52.185108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.185983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.187504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.188279 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.241794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.243009 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.243921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.244654 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:53.230386 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e1c349c9-4c3e-4c50-8f50-985ca3b92ddb tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Action: 'create', calling method: .version_select at 0x7fb7d2df0dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2023506109", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:53.293649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fc1b5818-2647-440b-b3f3-e6ab7f59ca6b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Action: 'create', calling method: .version_select at 0x7fb7d2df0dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1620784786"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.305802 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e1c349c9-4c3e-4c50-8f50-985ca3b92ddb tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.143375 Aug 07 01:16:55.306765 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Aug 7 01:16:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3146 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 01:16:55.476178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ff2996f2-e326-469f-93b7-51714872071d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Action: 'create', calling method: .version_select at 0x7fb7d2cdfc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-945264414", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ff2996f2-e326-469f-93b7-51714872071d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 121 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.483310 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-945264414", "metadata": {"Type": "work"}}} Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.484954 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-945264414', 'metadata': {'Type': 'work'}}}} Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.485752 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:16:55.487195 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:16:55.488376 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:16:55.488376 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.488376 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ff2996f2-e326-469f-93b7-51714872071d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.488376 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ff2996f2-e326-469f-93b7-51714872071d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.175861 Aug 07 01:16:55.488376 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Aug 7 01:16:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:16:55.492763 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-041d6f77-8dd8-4bc4-90bc-fea0b0ce48a0 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c39670>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.547311 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-041d6f77-8dd8-4bc4-90bc-fea0b0ce48a0 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 200 len: 353 microversion: 2.1 time: 0.061298 Aug 07 01:16:55.548082 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 3/3] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:55.554687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-12030b6c-0bcb-4cdb-93d5-cd07d533cb0f tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Action: 'create', calling method: .version_select at 0x7fb7d2c7d430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-790772092", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-12030b6c-0bcb-4cdb-93d5-cd07d533cb0f tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 119 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.558948 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-790772092", "metadata": {"Type": "work"}}} Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.560510 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-790772092', 'metadata': {'Type': 'work'}}}} Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi '0' Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.561420 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:16:55.562958 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:16:55.564405 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:16:55.564405 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.565392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-12030b6c-0bcb-4cdb-93d5-cd07d533cb0f tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.566493 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-12030b6c-0bcb-4cdb-93d5-cd07d533cb0f tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017146 Aug 07 01:16:55.567192 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 4/4] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Aug 7 01:16:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:16:55.577135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-29e020b8-ebd3-4c10-bd74-9364c687ac86 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Action: 'create', calling method: .version_select at 0x7fb7d2c39820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1288263124", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-29e020b8-ebd3-4c10-bd74-9364c687ac86 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 119 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.581352 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1288263124", "metadata": {"Type": "work"}}} Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.582818 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1288263124', 'metadata': {'Type': 'work'}}}} Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi '' Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.583870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:16:55.587197 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:16:55.588568 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:16:55.588568 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.589607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-29e020b8-ebd3-4c10-bd74-9364c687ac86 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.590849 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-29e020b8-ebd3-4c10-bd74-9364c687ac86 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018190 Aug 07 01:16:55.591609 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 5/5] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Aug 7 01:16:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:16:55.607898 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e2a825d-c248-49e5-a143-ff93e214c886 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Calling method '.version_select at 0x7fb7d2c39ee0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.682903 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-7e2a825d-c248-49e5-a143-ff93e214c886 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] HTTP exception thrown: Volume tempest-invalid-1767638087 could not be found. Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e2a825d-c248-49e5-a143-ff93e214c886 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1767638087 HTTP/1.1 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.686829 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Volume tempest-invalid-1767638087 could not be found. Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'tempest-invalid-1767638087'} Aug 07 01:16:55.689083 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1767638087 could not be found. (HTTP 404) (Request-ID: req-820d8429-4343-4ad3-a441-81faba7dddb5) Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.689885 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:16:55.691117 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1767638087 could not be found. Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:55.692174 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1767638087 could not be found. Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1767638087 could not be found. Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e2a825d-c248-49e5-a143-ff93e214c886 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 404 to user: Volume tempest-invalid-1767638087 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7e2a825d-c248-49e5-a143-ff93e214c886 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1767638087" status: 404 len: 99 microversion: 2.1 time: 0.085690 Aug 07 01:16:55.693366 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 6/6] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Aug 7 01:16:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1767638087 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:16:55.698897 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d401122d-bf0f-417f-8006-bdb797e87d76 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004136 Aug 07 01:16:55.702824 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 7/7] 10.222.0.36 () {58 vars in 1140 bytes} [Sun Aug 7 01:16:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:16:55.708316 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-40ab56a6-0f4a-4f72-9025-2b78ef5585c3 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004266 Aug 07 01:16:55.713470 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 8/8] 10.222.0.36 () {58 vars in 1137 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:16:55.721423 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e42beb0-d87b-473f-bc12-b4a793a7f7a5 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Calling method '.version_select at 0x7fb7d2c45160>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.776411 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-5e42beb0-d87b-473f-bc12-b4a793a7f7a5 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] HTTP exception thrown: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e42beb0-d87b-473f-bc12-b4a793a7f7a5 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/aed8f0f6-64e3-4507-9fff-b2c40c991d0e HTTP/1.1 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.778963 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'aed8f0f6-64e3-4507-9fff-b2c40c991d0e'} Aug 07 01:16:55.780209 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. (HTTP 404) (Request-ID: req-4eab5d45-3e7c-4ae9-b57f-ff8d2aa0166f) Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.781023 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:16:55.782237 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:16:55.783370 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e42beb0-d87b-473f-bc12-b4a793a7f7a5 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 404 to user: Volume aed8f0f6-64e3-4507-9fff-b2c40c991d0e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.784428 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5e42beb0-d87b-473f-bc12-b4a793a7f7a5 tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/aed8f0f6-64e3-4507-9fff-b2c40c991d0e" status: 404 len: 109 microversion: 2.1 time: 0.064394 Aug 07 01:16:55.786844 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 9/9] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:16:55 2022] DELETE /compute/v2.1/os-volumes/aed8f0f6-64e3-4507-9fff-b2c40c991d0e => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:16:55.791320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c14fbce1-9fe0-405b-9178-8cca63f50e1d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Calling method '.version_select at 0x7fb7d2c39af0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.825888 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-c14fbce1-9fe0-405b-9178-8cca63f50e1d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] HTTP exception thrown: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c14fbce1-9fe0-405b-9178-8cca63f50e1d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Request method failure captured: Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/os-volumes/c61d08bc-a6e1-4dbd-a946-eaa688aeda71 HTTP/1.1 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKFaDLkN1mtznL3sGKiD4VRKbpJkZhCl-A1JgFYHzK_FCRb8lQZ2q3ghQQ6GlVK8SIGaZml4mdw-MGfWULfGBfFSC0cF5ujfUr3QSJJQEuGfJyiqYINhOuPEJou1Oc4rlCz26pmOSQn5Nu3HQzF1D9aY0SQYozFdTybAP1v4wCmgOM Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:55.828699 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e62884877034740b93cef500446d246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e62884877034740b93cef500446d246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e62884877034740b93cef500446d246", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 3e62884877034740b93cef500446d246 Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1656415711 Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 80dad7e132d848559aa3529427e92f6e Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1656415711-project Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'c61d08bc-a6e1-4dbd-a946-eaa688aeda71'} Aug 07 01:16:55.843698 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. (HTTP 404) (Request-ID: req-a7bc8839-7ccd-4804-a5bc-58de60eab266) Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.844593 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:16:55.847118 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:16:55.850681 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c14fbce1-9fe0-405b-9178-8cca63f50e1d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] Returning 404 to user: Volume c61d08bc-a6e1-4dbd-a946-eaa688aeda71 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c14fbce1-9fe0-405b-9178-8cca63f50e1d tempest-VolumesNegativeTest-1656415711 tempest-VolumesNegativeTest-1656415711-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c61d08bc-a6e1-4dbd-a946-eaa688aeda71" status: 404 len: 109 microversion: 2.1 time: 0.044477 Aug 07 01:16:55.854954 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 10/10] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/os-volumes/c61d08bc-a6e1-4dbd-a946-eaa688aeda71 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:56.006035 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fc1b5818-2647-440b-b3f3-e6ab7f59ca6b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.736475 Aug 07 01:16:56.006035 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 1/11] 10.222.0.36 () {60 vars in 1155 bytes} [Sun Aug 7 01:16:52 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3739 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 07 01:16:56.342732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-31c674da-839e-48d8-9650-c5652265c3c3 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c7d3a0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:56.342732 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-31c674da-839e-48d8-9650-c5652265c3c3 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 200 len: 345 microversion: 2.1 time: 0.062395 Aug 07 01:16:56.342732 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 11/12] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:56 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:56.569982 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-acab54f5-73d0-494a-8d18-d7bbaf1a2e1b tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c6cc10>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:56.677526 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-acab54f5-73d0-494a-8d18-d7bbaf1a2e1b tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 200 len: 353 microversion: 2.1 time: 0.118626 Aug 07 01:16:56.679609 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 2/13] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:56 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:57.092539 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1f7c1852-35ae-4c9b-a227-7ddc6c6a9dd0 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c39ee0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:57.149359 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1f7c1852-35ae-4c9b-a227-7ddc6c6a9dd0 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 200 len: 345 microversion: 2.1 time: 0.061067 Aug 07 01:16:57.150210 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 12/14] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:57 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:57.699417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7adc29e0-f03d-4357-ae43-24d248a6ec07 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c813a0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:57.817740 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7adc29e0-f03d-4357-ae43-24d248a6ec07 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 200 len: 354 microversion: 2.1 time: 0.127753 Aug 07 01:16:57.818371 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 3/15] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:57 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:57.832939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf0c5f33-27f9-4828-bafe-487cc40a1d67 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c45700>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:57.891666 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cf0c5f33-27f9-4828-bafe-487cc40a1d67 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 200 len: 354 microversion: 2.1 time: 0.064136 Aug 07 01:16:57.897978 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 13/16] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:57 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:57.913658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-98e38c27-d1e1-44d4-96b1-e63360512703 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c81a60>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:58.163994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f96be805-d38a-4211-bf1c-5ab8599d3dcd tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c45940>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:58.219898 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-98e38c27-d1e1-44d4-96b1-e63360512703 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 202 len: 0 microversion: 2.1 time: 0.311340 Aug 07 01:16:58.220324 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 4/17] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:16:57 2022] DELETE /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:16:58.239319 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4562bb02-619a-449c-b0d2-41852a05a93b tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c6cdc0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:58.329978 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f96be805-d38a-4211-bf1c-5ab8599d3dcd tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 200 len: 346 microversion: 2.1 time: 0.169864 Aug 07 01:16:58.331155 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 14/18] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:58 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 346 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:16:58.363979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-821a752b-cf24-401e-af34-dd5f150c369f tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Action: 'create', calling method: .version_select at 0x7fb7d2c390d0>, body: {"snapshot": {"volume_id": "2435ef66-e768-481e-bb02-1e56283c674b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-898810848"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:58.436181 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4562bb02-619a-449c-b0d2-41852a05a93b tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 200 len: 353 microversion: 2.1 time: 0.206539 Aug 07 01:16:58.443507 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 5/19] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:58 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:59.372607 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-821a752b-cf24-401e-af34-dd5f150c369f tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.027969 Aug 07 01:16:59.386243 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 15/20] 10.222.0.36 () {60 vars in 1162 bytes} [Sun Aug 7 01:16:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:59.389259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0e329710-8113-4c78-ac33-dcde7d412998 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c81af0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.456190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2282b89d-2868-4812-8578-b5d9af7763a5 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Calling method '.version_select at 0x7fb7d2c45b80>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.472130 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0e329710-8113-4c78-ac33-dcde7d412998 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 200 len: 286 microversion: 2.1 time: 0.086857 Aug 07 01:16:59.473646 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 6/21] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:59.485453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-141d6b5f-b337-4099-a5ec-4c290f052b75 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c813a0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.568130 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-2282b89d-2868-4812-8578-b5d9af7763a5 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] HTTP exception thrown: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2282b89d-2868-4812-8578-b5d9af7763a5 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Request method failure captured: Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 HTTP/1.1 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKEADAVArb0OLfjvnPywOHklMounXPMF5UbKHFtdq4pAQoJxDSONr7nn8BRFuSA0wJ6V0I68jQGvE5a56ReCywQFGEwRlcGEQsxq5LmIwOPA_h9CuDS0nff3QuoCr8OkGI91ePILbhDHeRpHpm9NFEnw6QXRq089SDqhbqbOsvUWwE Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 6e84809683e046abb1963435906f5fe9 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesGetTestJSON-2052672644 Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:16:59.576461 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e84809683e046abb1963435906f5fe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e84809683e046abb1963435906f5fe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e84809683e046abb1963435906f5fe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e84809683e046abb1963435906f5fe9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesGetTestJSON-2052672644 Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 6e84809683e046abb1963435906f5fe9 Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesGetTestJSON-2052672644 Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesGetTestJSON-2052672644-project Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 51f00971f84945329095ca8b846dfb90 Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesGetTestJSON-2052672644-project Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'e6e2f287-0143-4e21-8258-d08d30197ca0'} Aug 07 01:16:59.577749 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. (HTTP 404) (Request-ID: req-17f534ec-550f-4679-96db-76f237740695) Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:59.578777 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:16:59.579705 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:16:59.580627 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2282b89d-2868-4812-8578-b5d9af7763a5 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] Returning 404 to user: Volume e6e2f287-0143-4e21-8258-d08d30197ca0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2282b89d-2868-4812-8578-b5d9af7763a5 tempest-VolumesGetTestJSON-2052672644 tempest-VolumesGetTestJSON-2052672644-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0" status: 404 len: 109 microversion: 2.1 time: 0.126549 Aug 07 01:16:59.581508 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 16/22] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/os-volumes/e6e2f287-0143-4e21-8258-d08d30197ca0 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:16:59.675812 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-141d6b5f-b337-4099-a5ec-4c290f052b75 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.194969 Aug 07 01:16:59.677905 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 7/23] 10.222.0.36 () {58 vars in 1140 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:59.691918 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9bc3ac0e-91dc-45cc-9365-345dc715d130 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c7d160>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.754696 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9bc3ac0e-91dc-45cc-9365-345dc715d130 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 200 len: 286 microversion: 2.1 time: 0.068467 Aug 07 01:16:59.765754 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 17/24] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:00.773754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-05d7ab8e-3fe1-4fad-8c6d-ce663a6d17f3 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c811f0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:00.837350 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-05d7ab8e-3fe1-4fad-8c6d-ce663a6d17f3 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 200 len: 287 microversion: 2.1 time: 0.068255 Aug 07 01:17:00.837933 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 8/25] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Aug 7 01:17:00 2022] GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:00.851708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e0d0af98-0dc0-46c7-a68a-2b7f98cc8898 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c39ca0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:01.104198 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e0d0af98-0dc0-46c7-a68a-2b7f98cc8898 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 202 len: 0 microversion: 2.1 time: 0.257970 Aug 07 01:17:01.104812 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 18/26] 10.222.0.36 () {58 vars in 1254 bytes} [Sun Aug 7 01:17:00 2022] DELETE /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:01.113125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3adcd3dc-c306-46d7-aacf-c2daae45d0be tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c819d0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:01.209933 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3adcd3dc-c306-46d7-aacf-c2daae45d0be tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 200 len: 286 microversion: 2.1 time: 0.099698 Aug 07 01:17:01.214866 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 9/27] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Aug 7 01:17:01 2022] GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:02.226190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a70b5ff4-7d5d-44d8-848e-6a41fb08cf1b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c45160>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:02.279425 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-a70b5ff4-7d5d-44d8-848e-6a41fb08cf1b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] HTTP exception thrown: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a70b5ff4-7d5d-44d8-848e-6a41fb08cf1b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Request method failure captured: Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df HTTP/1.1 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKEcpQIapExKLqpb6ymR7Wa5zSU702XMJCWrOFHGEVQLDoX1vc1KTWga63ktGqU8BI5jQlgigKLaofx-7B93dZQJbMe6QeqRWPvLxwBwK11amoZl3PcsIn3lZzrgpeSuV9oLH7ldjvgzvSKzEf8GjAgU5wo8fBMQhMrA5U0eOoCUh4 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:17:02.283855 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fc3a83aac14941e0b7ac06feccc04b5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 05dae98109b14ac7a5b4bcaaeb17e00c Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '4c64a805-88b8-4ff2-a7b2-1d60b1c117df'} Aug 07 01:17:02.285154 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. (HTTP 404) (Request-ID: req-89682225-31c2-45bb-8a52-91ba53c922c9) Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.285977 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:02.287059 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 01:17:02.289972 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a70b5ff4-7d5d-44d8-848e-6a41fb08cf1b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Returning 404 to user: Snapshot 4c64a805-88b8-4ff2-a7b2-1d60b1c117df could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:02.297796 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a70b5ff4-7d5d-44d8-848e-6a41fb08cf1b tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df" status: 404 len: 111 microversion: 2.1 time: 0.073017 Aug 07 01:17:02.300062 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 19/28] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Aug 7 01:17:02 2022] GET /compute/v2.1/os-snapshots/4c64a805-88b8-4ff2-a7b2-1d60b1c117df => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:02.301843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8b43c0b9-ed62-4142-a7a6-d3363237ae08 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c6cc10>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:02.670576 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8b43c0b9-ed62-4142-a7a6-d3363237ae08 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 202 len: 0 microversion: 2.1 time: 0.372332 Aug 07 01:17:02.671771 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 10/29] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:17:02 2022] DELETE /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:02.681658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9879656a-1a7a-4b74-95c7-03b71bdd2230 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c451f0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:02.803746 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9879656a-1a7a-4b74-95c7-03b71bdd2230 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 200 len: 345 microversion: 2.1 time: 0.127221 Aug 07 01:17:02.804303 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 20/30] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:02 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:03.819480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0669ed6d-f852-43d9-b72f-650f2c0961df tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c6caf0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.863425 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-0669ed6d-f852-43d9-b72f-650f2c0961df tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] HTTP exception thrown: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0669ed6d-f852-43d9-b72f-650f2c0961df tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Request method failure captured: Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b HTTP/1.1 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKEcpQIapExKLqpb6ymR7Wa5zSU702XMJCWrOFHGEVQLDoX1vc1KTWga63ktGqU8BI5jQlgigKLaofx-7B93dZQJbMe6QeqRWPvLxwBwK11amoZl3PcsIn3lZzrgpeSuV9oLH7ldjvgzvSKzEf8GjAgU5wo8fBMQhMrA5U0eOoCUh4 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:17:03.869145 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fc3a83aac14941e0b7ac06feccc04b5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 05dae98109b14ac7a5b4bcaaeb17e00c Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '2435ef66-e768-481e-bb02-1e56283c674b'} Aug 07 01:17:03.870514 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. (HTTP 404) (Request-ID: req-0a1780bb-8355-462d-8e97-201d74163899) Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.871267 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:03.872402 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:17:03.873254 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0669ed6d-f852-43d9-b72f-650f2c0961df tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Returning 404 to user: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0669ed6d-f852-43d9-b72f-650f2c0961df tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 404 len: 109 microversion: 2.1 time: 0.055625 Aug 07 01:17:03.874257 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 11/31] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:03 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:03.882327 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb173ac6-f000-4b40-8d6a-3b82dff3b33e tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d2c45820>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.925897 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-bb173ac6-f000-4b40-8d6a-3b82dff3b33e tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] HTTP exception thrown: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb173ac6-f000-4b40-8d6a-3b82dff3b33e tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Request method failure captured: Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b HTTP/1.1 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKEcpQIapExKLqpb6ymR7Wa5zSU702XMJCWrOFHGEVQLDoX1vc1KTWga63ktGqU8BI5jQlgigKLaofx-7B93dZQJbMe6QeqRWPvLxwBwK11amoZl3PcsIn3lZzrgpeSuV9oLH7ldjvgzvSKzEf8GjAgU5wo8fBMQhMrA5U0eOoCUh4 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:17:03.931651 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fc3a83aac14941e0b7ac06feccc04b5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 05dae98109b14ac7a5b4bcaaeb17e00c Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '2435ef66-e768-481e-bb02-1e56283c674b'} Aug 07 01:17:03.932794 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. (HTTP 404) (Request-ID: req-2b0fd6be-bc3c-4f50-8e35-f2ad37073680) Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.933429 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:17:03.934381 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:17:03.935361 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb173ac6-f000-4b40-8d6a-3b82dff3b33e tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Returning 404 to user: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bb173ac6-f000-4b40-8d6a-3b82dff3b33e tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 404 len: 109 microversion: 2.1 time: 0.052556 Aug 07 01:17:03.936326 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 21/32] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:17:03 2022] DELETE /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:03.940419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5e19c1d4-20f5-4fba-8ce2-6ec74aff7669 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Calling method '.version_select at 0x7fb7d35f5280>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.998493 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-5e19c1d4-20f5-4fba-8ce2-6ec74aff7669 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] HTTP exception thrown: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5e19c1d4-20f5-4fba-8ce2-6ec74aff7669 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Request method failure captured: Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b HTTP/1.1 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKEcpQIapExKLqpb6ymR7Wa5zSU702XMJCWrOFHGEVQLDoX1vc1KTWga63ktGqU8BI5jQlgigKLaofx-7B93dZQJbMe6QeqRWPvLxwBwK11amoZl3PcsIn3lZzrgpeSuV9oLH7ldjvgzvSKzEf8GjAgU5wo8fBMQhMrA5U0eOoCUh4 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:17:04.000495 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fc3a83aac14941e0b7ac06feccc04b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fc3a83aac14941e0b7ac06feccc04b5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: fc3a83aac14941e0b7ac06feccc04b5e Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-637028291 Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 05dae98109b14ac7a5b4bcaaeb17e00c Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-VolumesSnapshotsTestJSON-637028291-project Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '2435ef66-e768-481e-bb02-1e56283c674b'} Aug 07 01:17:04.001703 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. (HTTP 404) (Request-ID: req-7b98683d-fbcd-436d-9cb3-12ff8ab18632) Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:04.002497 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:17:04.003400 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:17:04.004332 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5e19c1d4-20f5-4fba-8ce2-6ec74aff7669 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] Returning 404 to user: Volume 2435ef66-e768-481e-bb02-1e56283c674b could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5e19c1d4-20f5-4fba-8ce2-6ec74aff7669 tempest-VolumesSnapshotsTestJSON-637028291 tempest-VolumesSnapshotsTestJSON-637028291-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b" status: 404 len: 109 microversion: 2.1 time: 0.067011 Aug 07 01:17:04.005178 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 12/33] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:03 2022] GET /compute/v2.1/os-volumes/2435ef66-e768-481e-bb02-1e56283c674b => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:07.970388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1065896333", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "364b547f-0424-4c36-9097-45d4ec6aa3b4"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:08.122087 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] validate_networks() for [('364b547f-0424-4c36-9097-45d4ec6aa3b4', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:10.695248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:10.696706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:10.703492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:10.703492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:10.703492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:10.716558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.717366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.717988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.719059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.719654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.720477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.749175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-12a1afaa-86b4-47bc-a6c6-a9cb43a0f2f2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: .version_select at 0x7fb7d2c889d0>, body: {"keypair": {"name": "tempest-keypair-687312122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIzjbMa0YnKsjoOCvSmqcUjxKYufPcRUr/N6s5e1uhPZujczs9kVNymS4yVv8kI99eMDhw2Q+AYUyRJXtEG0nGW9vhVnPyvv9avME9Q8U15aCBF0S/imNAfjg8Bwg9QgQ=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:10.776397 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Getting quotas for project 90a4367254cc4a318f7abe3a16821bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:10.805248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Getting quotas for user f270593db29b4835952de74f591011c5 and project 90a4367254cc4a318f7abe3a16821bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:10.809617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-12a1afaa-86b4-47bc-a6c6-a9cb43a0f2f2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for project 6785d30930ee41d88a31ff0760f8d699. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:10.817931 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-12a1afaa-86b4-47bc-a6c6-a9cb43a0f2f2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for user 598402f6609c422cbcc0dd0bfae53430 and project 6785d30930ee41d88a31ff0760f8d699. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:10.839815 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:10.843737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:10.980935 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-12a1afaa-86b4-47bc-a6c6-a9cb43a0f2f2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.664675 Aug 07 01:17:10.982066 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 13/34] 10.222.0.36 () {62 vars in 1200 bytes} [Sun Aug 7 01:17:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 666 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:17:11.145567 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-242a13e0-6be6-471c-987b-8398060a121d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.728319 Aug 07 01:17:11.147902 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 22/35] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:17:11.183561 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f21a48d1-a057-48e9-b547-d4f676a09905 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:11.190550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f21a48d1-a057-48e9-b547-d4f676a09905 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:11.425527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f21a48d1-a057-48e9-b547-d4f676a09905 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.444605 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f21a48d1-a057-48e9-b547-d4f676a09905 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1215 microversion: 2.1 time: 0.287497 Aug 07 01:17:11.445187 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 23/36] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:11 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:11.594424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9e816e57-22cb-454a-a7ac-33c076e3ab6c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: .version_select at 0x7fb7d2bb9940>, body: {"keypair": {"name": "tempest-keypair-1754802521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTMdxnubQSVHMCQrgO/kgn84dW1JlQdyeX/zjV2cOPL4lvft+n8CwBW1Wh1f68NgXt2UiTKaePTjP4ez6+wyo2SMJcDg2rKwjAngv/e/gmwVYWdS7biQ4zvttnsPacrSw=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:11.623111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-9e816e57-22cb-454a-a7ac-33c076e3ab6c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for project 440652d4d24d4a34985625be49c12a70. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:11.633401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-9e816e57-22cb-454a-a7ac-33c076e3ab6c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for user 4c8389683e844b989fe5cbe779327933 and project 440652d4d24d4a34985625be49c12a70. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:11.760970 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9e816e57-22cb-454a-a7ac-33c076e3ab6c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.777456 Aug 07 01:17:11.762102 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 14/37] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:17:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:12.467965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4f5bc8fe-8922-4144-a7e8-92edb5fdd3e3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:12.468602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4f5bc8fe-8922-4144-a7e8-92edb5fdd3e3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:12.479500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-466c574d-a64d-4cfb-8909-94668c06834f tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d2372dc0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:12.576363 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-466c574d-a64d-4cfb-8909-94668c06834f tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a97626f6-75b4-49b3-a373-10614261bacb" status: 200 len: 351 microversion: 2.1 time: 0.104908 Aug 07 01:17:12.577761 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 15/38] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:12 2022] GET /compute/v2.1/os-volumes/a97626f6-75b4-49b3-a373-10614261bacb => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:12.656497 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4f5bc8fe-8922-4144-a7e8-92edb5fdd3e3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:12.666217 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4f5bc8fe-8922-4144-a7e8-92edb5fdd3e3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1215 microversion: 2.1 time: 0.203646 Aug 07 01:17:12.685859 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 24/39] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:12 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:13.702749 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e3641221-d124-427f-9a6e-f705307ffe1a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:13.704363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e3641221-d124-427f-9a6e-f705307ffe1a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:13.986273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e3641221-d124-427f-9a6e-f705307ffe1a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:14.016917 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e3641221-d124-427f-9a6e-f705307ffe1a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1215 microversion: 2.1 time: 0.321103 Aug 07 01:17:14.019100 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 16/40] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:13 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:14.667558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-387fc519-30aa-4a59-b1ef-2d9956803baa tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d1ac2b80>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:14.850462 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-387fc519-30aa-4a59-b1ef-2d9956803baa tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1fcb3ca2-d9fd-44e2-ae34-53232ee03a5a" status: 200 len: 351 microversion: 2.1 time: 0.187358 Aug 07 01:17:14.851397 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 25/41] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:14 2022] GET /compute/v2.1/os-volumes/1fcb3ca2-d9fd-44e2-ae34-53232ee03a5a => generated 351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:15.040769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:15.041267 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:15.050854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.051354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.052572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.053097 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.053555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.061782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.470972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.503479 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-eb78e9dd-86c9-4c13-aac2-c409bdeb9e1e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1219 microversion: 2.1 time: 0.466637 Aug 07 01:17:15.509178 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 17/42] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:15 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1219 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:16.141670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1959573924", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c03bb01c-9570-4dec-aa6b-e3790ed83c98"}], "security_groups": [{"name": "tempest-securitygroup--922726822"}], "key_name": "tempest-keypair-687312122", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:16.378430 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] validate_networks() for [('c03bb01c-9570-4dec-aa6b-e3790ed83c98', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:16.531044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:16.531650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:16.542186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.544483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.546384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.548694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.549373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.550341 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.041317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:17.041317 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-87111b63-1679-4d7a-acdf-e5566d2e3267 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1267 microversion: 2.1 time: 0.437495 Aug 07 01:17:17.041317 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 18/43] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1267 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:17.044686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-626882805", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7412368-3b33-4779-8fa8-86d88886c06e"}], "security_groups": [{"name": "tempest-securitygroup--1767695113"}], "key_name": "tempest-keypair-1754802521", "user_data": "}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:17.240376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] validate_networks() for [('d7412368-3b33-4779-8fa8-86d88886c06e', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:17.757538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:17.763121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:17.763121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:17.763121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:17.763121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:17.774366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.778331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.778991 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.781937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.782609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.783207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.835480 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for project 6785d30930ee41d88a31ff0760f8d699. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:17.845508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for user 598402f6609c422cbcc0dd0bfae53430 and project 6785d30930ee41d88a31ff0760f8d699. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:17.905004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:17.907245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:18.111399 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4d0106d5-892b-4bc7-8b14-7c61f21a5989 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.985264 Aug 07 01:17:18.124512 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 26/44] 10.222.0.36 () {62 vars in 1188 bytes} [Sun Aug 7 01:17:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:17:18.137457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.138298 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:18.158791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.160353 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.163559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.164618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.165248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.165909 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.645540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.668241 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6ad16a59-acda-484d-95ab-b1db2b5b3b19 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1273 microversion: 2.1 time: 0.547215 Aug 07 01:17:18.669843 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 27/45] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:18.700809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.701438 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:18.845454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.858309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.860317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.867618 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-06781900-4603-478a-b121-ac965afb67ae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1281 microversion: 2.20 time: 0.196379 Aug 07 01:17:18.882989 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 28/46] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:19.095521 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1a90e37d-4d5f-45ee-b675-7b7d05773d06 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d19f93a0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.292143 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1a90e37d-4d5f-45ee-b675-7b7d05773d06 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/753044ec-53f0-4dc7-a015-99ee1e70b853" status: 200 len: 351 microversion: 2.1 time: 0.204248 Aug 07 01:17:19.292801 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 29/47] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/os-volumes/753044ec-53f0-4dc7-a015-99ee1e70b853 => generated 351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:17:19.326278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5c769cee-d53e-42f7-9349-5d67dbcbee56 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d19f9a60>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.383062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:19.383670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:19.383949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:19.384355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:19.384773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:19.440005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.440538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.449013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.452180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.452675 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.453117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.482091 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5c769cee-d53e-42f7-9349-5d67dbcbee56 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.158742 Aug 07 01:17:19.498929 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 30/48] 10.222.0.36 () {58 vars in 1134 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:19.506944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aaa572d0-a58e-44ac-9b22-9a66926cc652 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d1a60700>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.575539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for project 440652d4d24d4a34985625be49c12a70. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:19.613475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for user 4c8389683e844b989fe5cbe779327933 and project 440652d4d24d4a34985625be49c12a70. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:19.663544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:19.666530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:19.764567 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aaa572d0-a58e-44ac-9b22-9a66926cc652 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.241517 Aug 07 01:17:19.764567 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 31/49] 10.222.0.36 () {58 vars in 1149 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:19.765447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.774035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:19.784783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.785380 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.785864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.787447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.788926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.789378 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.018067 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-535efae9-9a18-488b-ac0c-c13e91a3821d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.047341 Aug 07 01:17:20.019450 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 19/50] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:17:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 3050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:17:20.046188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7b78e4af-9d5c-4d25-9176-55c11613de66 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d21f9ca0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.143835 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.166766 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-43e2c3df-f69d-4fbb-91e2-b19b2db7b997 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.420729 Aug 07 01:17:20.199681 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 32/51] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.223060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.225505 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:20.420413 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7b78e4af-9d5c-4d25-9176-55c11613de66 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.398019 Aug 07 01:17:20.422036 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 20/52] 10.222.0.36 () {58 vars in 1134 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.449189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c93a2899-3208-468b-81f2-0e543e155def tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.450554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c93a2899-3208-468b-81f2-0e543e155def tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:20.468660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.484132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.486015 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.487170 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-21ee44b3-576c-4d6f-8881-01105a4f3f6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1281 microversion: 2.20 time: 0.286372 Aug 07 01:17:20.487798 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 33/53] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:20.523838 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0b592599-5c71-4c7a-9b45-6634b24f1e4f tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d1a1db80>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.618185 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c93a2899-3208-468b-81f2-0e543e155def tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.630832 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c93a2899-3208-468b-81f2-0e543e155def tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1237 microversion: 2.1 time: 0.205929 Aug 07 01:17:20.633302 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 21/54] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1237 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.707497 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0b592599-5c71-4c7a-9b45-6634b24f1e4f tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189778 Aug 07 01:17:20.729012 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 34/55] 10.222.0.36 () {58 vars in 1167 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:20.741782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6a14833b-8117-4bf2-8fd1-afaa9e21e439 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d2213a60>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.992758 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6a14833b-8117-4bf2-8fd1-afaa9e21e439 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.249297 Aug 07 01:17:20.992758 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 22/56] 10.222.0.36 () {58 vars in 1170 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:21.015443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-41614a9b-6452-4f3a-816c-cc53d46d0f9b tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d19aee50>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.202612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.203600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.216925 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-41614a9b-6452-4f3a-816c-cc53d46d0f9b tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.205349 Aug 07 01:17:21.226772 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 35/57] 10.222.0.36 () {58 vars in 1155 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:21.230695 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.232427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.232658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c8325784-61c6-44df-bed2-57186d5e7697 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d19f93a0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.236648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.240258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.243935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.245190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.522565 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c8325784-61c6-44df-bed2-57186d5e7697 tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.294009 Aug 07 01:17:21.523779 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 36/58] 10.222.0.36 () {58 vars in 1188 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:21.529844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.530657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.555043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.561771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.566508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.571706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.571706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.575479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.716676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.726396 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-233ed5d7-0807-4214-bd92-7f565a3e11d5 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.534510 Aug 07 01:17:21.728215 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 23/59] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:21.733032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-119b2dd3-01e1-48dd-a32d-a2e667a32bbf tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] Calling method '.version_select at 0x7fb7d22138b0>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.779281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.798065 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.800151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.802368 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3b39315d-8790-42ac-96c2-6d0251915436 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1285 microversion: 2.20 time: 0.276651 Aug 07 01:17:21.818944 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 37/60] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:21.830483 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f068a288-b4ed-43cf-8b71-e563597e179e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.837772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f068a288-b4ed-43cf-8b71-e563597e179e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.854358 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-119b2dd3-01e1-48dd-a32d-a2e667a32bbf tempest-VolumesTestJSON-397359660 tempest-VolumesTestJSON-397359660-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.125050 Aug 07 01:17:21.854943 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 24/61] 10.222.0.36 () {58 vars in 1155 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:22.002700 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f068a288-b4ed-43cf-8b71-e563597e179e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:22.012797 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f068a288-b4ed-43cf-8b71-e563597e179e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1237 microversion: 2.1 time: 0.191799 Aug 07 01:17:22.040098 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 38/62] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:22.695473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee88aad-cfc0-4271-a6b1-95aeb473bf0d", "tag": "db0b25ff-15e1-457a-9dbd-6722a5426fad"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:22.708878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.709419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.709818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.730020 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Creating event network-changed:db0b25ff-15e1-457a-9dbd-6722a5426fad for instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d on hv-cinder-maste Aug 07 01:17:22.730698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:17:22.730937 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9a97dddc-d178-4aa7-9c0c-6873492b6c25 req-ccc6c952-3e82-4f6d-a9c7-dce660b13787 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:17:22.732051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.732524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.732958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.733689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.734344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.734941 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.745594 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.compute.rpcapi [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 01:17:22.746562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] Releasing lock "compute-rpcapi-router" {{(pid=118310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:17:22.759194 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.765114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:22.773578 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.775016 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.776118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.777181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.778252 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.778871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.790112 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-099a8877-ba5e-4d45-aa87-4f61a04b7c06 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177763 Aug 07 01:17:22.791251 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 25/63] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:22.833098 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.834013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:22.842664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.843577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.844107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.844893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.845739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.846460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.992768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:22.993062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:23.004635 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-49acfc12-2b84-4a2f-9921-01871f782b43 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.249556 Aug 07 01:17:23.005986 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 39/64] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:22 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:23.022290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:23.033692 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:23.033692 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4ae3647c-1a83-45f3-bfa8-54f70f291e6d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.201590 Aug 07 01:17:23.033692 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 26/65] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:22 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:23.039779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:23.040382 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:23.052416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.053281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.053780 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.054637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.055225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.056048 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.132771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:23.150639 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-05e5d669-a1da-4cbd-9b0b-ca2730ab5c3a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.115259 Aug 07 01:17:23.188000 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 40/66] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:23 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:24.026478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:24.050592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:24.058577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:24.060034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:24.074183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.075191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.075330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.075706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.077435 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.078081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.078972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.079700 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.080194 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.081028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.085107 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.090573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.224715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:24.234278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:24.246321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:24.247808 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-69b3f25a-e11d-4b67-82e5-e87f7f2ebb2b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.196293 Aug 07 01:17:24.266245 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 41/67] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:24 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:24.272583 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:24.272583 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:24.279605 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:24.284864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.285643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.286665 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.287859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:24.287982 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9c2bbc05-5ac6-4adc-9043-1edeffa5a0a0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.266458 Aug 07 01:17:24.288606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:24.289328 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 27/68] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:24 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:24.289452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.386100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:24.398926 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-489feb19-dbb0-4e45-bc52-5112b2caca16 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.131244 Aug 07 01:17:24.399703 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 42/69] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:24 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:25.273651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:25.274304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:25.287951 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.288479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.288958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.289656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.290145 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.290573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.308331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:25.313542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:25.320982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.321479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.321946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.322660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.323105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.323529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.361453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.378800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.390415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.397668 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-91620f3b-f74f-4a65-8f64-08e1c8b12a9c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.128571 Aug 07 01:17:25.398448 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 28/70] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:25 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:25.436587 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:25.439423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:25.455291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.455876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.457276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.462620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:25.463121 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:25.463562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:25.606919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.620686 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8cfead78-f9d8-40e4-a0ee-3d7bc5573137 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.313352 Aug 07 01:17:25.620686 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 43/71] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:25 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:25.623456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.633076 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3a5b41a2-5d68-46e4-8135-b247b44e15f0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.216496 Aug 07 01:17:25.635713 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 29/72] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:25 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:26.420763 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:26.421407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:26.427394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.427885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.428311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.429007 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.429457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.429899 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.517142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:26.530014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:26.530014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:26.530014 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cb92a5e7-b324-4dac-b0ed-fc0287b4dd3a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.112817 Aug 07 01:17:26.534118 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 44/73] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:26 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:26.639366 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:26.640029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:26.647717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.648729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.654528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:26.655459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:26.664921 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.665622 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.666169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.666452 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.667137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.667567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.667997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.668179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.668796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.668969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.778893 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:26.794232 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dd5e7761-1f5e-4150-8280-8d0eda908e41 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.138102 Aug 07 01:17:26.804089 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 45/74] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:26 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:26.923125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:26.936882 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6c1b5150-3715-47ab-90dd-6a6cdd559225 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.301360 Aug 07 01:17:26.950853 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 30/75] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:26 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:27.555342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.558636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:27.569337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.570099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.570744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.571625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.572228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.572802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.663084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:27.674279 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:27.675743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:27.677359 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6e323b1d-4837-44c4-934e-960575ca9a13 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.126369 Aug 07 01:17:27.678403 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 46/76] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:27.813264 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.818270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:27.824658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.826991 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.827620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.828335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.829004 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.829442 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.914680 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:27.922586 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5be999cc-a000-40dc-9b7b-1708577d1e8b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.113409 Aug 07 01:17:27.923160 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 31/77] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:27.958207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.958806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:27.960766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:27.966006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.966111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.966516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.967203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.967652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.968079 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:28.189693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:28.198631 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3a5c5716-dfe8-466b-80a9-9ade4aa0817c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.244709 Aug 07 01:17:28.199286 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 47/78] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:28.706108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:28.706108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:28.710428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:28.713825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:28.713825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:28.713825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:28.713825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:28.714338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:28.782870 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:28.792284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:28.793996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:28.796210 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4513b2e6-c7e0-45cb-a2fe-a24775df2724 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.096864 Aug 07 01:17:28.808883 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 32/79] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:28 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:28.951262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:28.951262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:28.955600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:28.956144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:28.956537 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:28.957250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:28.957701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:28.958150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.037085 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.046007 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e774a82d-c0ae-46d2-8e16-bcf924669ef0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.102383 Aug 07 01:17:29.046928 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 48/80] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:28 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:29.220793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:29.221538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:29.231880 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.232852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.233391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.234147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.234605 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.235192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.377183 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.386081 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-edb2c8d8-2d87-4745-be38-c6a495012a52 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.169534 Aug 07 01:17:29.386900 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 33/81] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:29 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:29.831188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:29.832987 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:29.845413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.846035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.846538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.847289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.847878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.848351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.912802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.920695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.922226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.923356 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-96355962-79c6-4a4e-84af-baa91ceef5ef tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.106741 Aug 07 01:17:29.927911 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 49/82] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:29 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:30.068120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:30.068991 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:30.075154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.075871 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.076308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.077441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.077904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.078421 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.140983 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:30.148983 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0bf96b18-ce80-43a1-bb35-e2a1f21d90bb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.085396 Aug 07 01:17:30.149547 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 34/83] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:30 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:30.407982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:30.408865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:30.416300 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.416877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.417466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.418181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.418637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.419059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.559003 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:30.567454 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f9f18cfc-7143-4e00-92cf-0d21c3046527 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.163706 Aug 07 01:17:30.568094 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 50/84] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:30 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:30.945607 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:30.946251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:30.948212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=18 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:30.953179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.953659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.954120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.954803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.955256 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.955679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.018125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.027021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.028532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.029652 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c59e3116-fc9f-4f3e-a4d9-d3f8cafb734d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.088118 Aug 07 01:17:31.030245 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 35/85] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:30 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:31.173942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:31.173942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:31.175571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.176053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.176487 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.177177 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.177629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.178089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.242552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.245957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:31.250370 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c9515623-5d65-46e8-868c-eb25705c43fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.085339 Aug 07 01:17:31.251009 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 51/86] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:31 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:31.591442 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:31.591442 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:31.596823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.597302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.597803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.598517 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.598965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.599379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.739068 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.752603 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c08d7a05-403a-4a6e-b71e-0637cdb96f33 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.167742 Aug 07 01:17:31.754546 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 36/87] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:31 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:32.055932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:32.056544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:32.058412 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=22 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:32.063127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.063606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.064040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.064726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.065176 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.065595 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.128290 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.136439 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.137968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.139057 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9444281a-9248-4dfc-877f-e52180158dbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.087217 Aug 07 01:17:32.139608 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 52/88] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:32 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:32.271606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:32.272219 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:32.278159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.278639 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.279073 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.279751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.280221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.280626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.365279 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.375075 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1512ea39-8471-4d3d-a017-71e4695df9b3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.107491 Aug 07 01:17:32.375837 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 37/89] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:32 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:32.774628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:32.775158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:32.776971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:32.781562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.782076 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.782506 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.783178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.783625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.784038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.994382 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.003347 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fb38f7f9-ac29-4f0c-85f6-2706c08e0164 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.232172 Aug 07 01:17:33.004871 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 53/90] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:32 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:33.163447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:33.164060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:33.166264 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=4 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:33.166976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:33.178317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.178824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.179255 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.179960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.180421 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.180846 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.200408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:33.244234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.257967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.257967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.257967 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c718c0bf-5ea7-419e-9fa8-e6ae4a15fbee tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.097141 Aug 07 01:17:33.258518 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 38/91] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:33 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:33.403665 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:33.404421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:33.414070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.414562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.415162 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.415863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.416320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.416732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.482658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.491041 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4170a18b-f0c4-44de-a756-48a7b9bc3616 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.098404 Aug 07 01:17:33.502258 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 54/92] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:33 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:34.025087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:34.025679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:34.031720 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.032205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.032641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.033339 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.033792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.034236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.176844 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:34.184251 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-47deb6c1-41b6-42bd-8705-150f4e308b87 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.163015 Aug 07 01:17:34.184810 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 39/93] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:34 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:34.278123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:34.279004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:34.285613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.302958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.302958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.302958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.302958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.303694 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.368504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:34.377617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:34.379848 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:34.380967 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c44ea64c-9545-4411-b990-f1cdf92af7c6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.107251 Aug 07 01:17:34.381586 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 55/94] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:34 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:34.520627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:34.520627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:34.526811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.528000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.528719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.529632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.530319 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.530936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.620284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:34.628003 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8dd73266-dd1e-402c-817d-dfdda4c3f64c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.118809 Aug 07 01:17:34.630042 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 40/95] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:34 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:35.205218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:35.205791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:35.212149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.212628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.213059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.213739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.214219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.214637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.359258 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.367067 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-640616dc-91b4-4a8c-8d91-ddf72dff81b0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.166402 Aug 07 01:17:35.372820 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 56/96] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:35 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:35.404979 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:35.405572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:35.412643 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.412643 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.413126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.413752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.414228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.414645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.477323 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.485181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.486750 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.487968 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-066de100-d6bf-49c7-a8c2-749d046a19ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.087247 Aug 07 01:17:35.499570 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 41/97] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:35 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:35.649715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:35.650037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:35.656123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.656623 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.657054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.657927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.658529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.658952 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.720684 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.728678 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dd9eaebd-af90-4884-bbaf-4311a805d2c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.083358 Aug 07 01:17:35.729244 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 57/98] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:35 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:36.391515 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:36.392571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:36.403131 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.403917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.404636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.405751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.406383 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.406922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.513742 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:36.515183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:36.525364 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.526043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.526629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.528658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.530646 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.531264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.650691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:36.662217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:36.668011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:36.679649 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eb587285-cee3-4bbd-a81a-7511ed58fa47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.170717 Aug 07 01:17:36.683814 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 58/99] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:36 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:36.751749 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:36.752420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:36.768429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.768429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.768429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.768429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:36.768730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:36.768730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.804645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:36.814460 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9c105da9-fd64-45a3-b958-32e0cf0d6368 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.430788 Aug 07 01:17:36.817548 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 42/100] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:36 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:36.839227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:36.851191 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4b5fd807-456a-4b59-b2ff-1705f7e531f8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.102471 Aug 07 01:17:36.860238 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 59/101] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:36 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:37.707747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:37.708392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:37.715370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.718939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.718939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.718939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.718939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.719484 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.785743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:37.797731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:37.799903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:37.811232 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fb4b9b2b-ab71-4e04-bc09-7fba85f5fb49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1277 microversion: 2.20 time: 0.102968 Aug 07 01:17:37.811232 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 43/102] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:37 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:37.849304 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:37.850036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:37.857745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.866421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.866421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.866421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.866421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.866959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.881504 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:37.882791 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:37.889652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.890596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.891347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.893074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.893996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.894862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.998822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.004246 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-848f5d1e-5824-472b-8d01-dcaa39e335e3 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1241 microversion: 2.1 time: 0.128169 Aug 07 01:17:38.005051 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 44/103] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:37 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:38.172272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.180169 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5707df64-c19b-445d-ba06-2af768cb413b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.335603 Aug 07 01:17:38.180762 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 60/104] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:37 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:38.834756 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:38.835380 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:38.851644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:38.852196 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:38.852648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:38.854484 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:38.858202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:38.858529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:38.930000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.938112 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.939641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.940815 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-15ca369e-8620-4532-8680-f449ffb05f47 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1333 microversion: 2.20 time: 0.110851 Aug 07 01:17:38.941540 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 45/105] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:38 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:39.026854 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:39.027744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:39.035183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.039849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.039849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.039849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.039849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.040191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.124176 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:39.132002 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-82b48fce-1103-437f-b632-7f28719e145c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1233 microversion: 2.1 time: 0.109011 Aug 07 01:17:39.132580 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 61/106] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:39 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1233 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:39.201983 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:39.202664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:39.211067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.214876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.214876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.214876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.214876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.215333 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.450248 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:39.450248 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-537f56b4-4c93-48ce-a3c1-401060bae303 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.233768 Aug 07 01:17:39.450248 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 46/107] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:39 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:39.970670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:39.976279 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:39.989220 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.989799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.990342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.991115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.991632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.992144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:40.114754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:40.131992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:40.134092 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:40.135240 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ba1dbf2c-b195-4849-aeb4-434e85f27850 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1341 microversion: 2.20 time: 0.175693 Aug 07 01:17:40.139880 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 62/108] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:39 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:40.160785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:40.161433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:40.188729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:40.190414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:40.191545 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:40.192438 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:40.193059 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:40.193632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:40.383509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:40.397257 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-39296a2b-eb2b-497f-81b3-a56676f16cd1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1289 microversion: 2.1 time: 0.242320 Aug 07 01:17:40.399528 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 47/109] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:40 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1289 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:40.470647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:40.495834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:40.495834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:40.495834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:40.495834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:40.496186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:40.496186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:40.496186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:40.650999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:40.658600 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-22b4083b-ee83-4676-a36b-d625d5016447 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.196376 Aug 07 01:17:40.659162 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 63/110] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:40 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:41.166114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:41.166700 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:41.172476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.172957 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.173394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.174090 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.174539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.174998 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.318000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.326087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.328061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.329186 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ffd93c1d-4064-4c5d-aa53-fbba92a83ffc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.167014 Aug 07 01:17:41.329796 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 48/111] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:41 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:41.420121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:41.420732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:41.430433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.432149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.432770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.434750 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.435444 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.439372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.511575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.519583 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-868db175-0231-4f6c-8287-839945c7d498 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1297 microversion: 2.1 time: 0.103115 Aug 07 01:17:41.520542 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 64/112] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:41 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:41.679566 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:41.680178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:41.686547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.687031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.687627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.688624 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.689217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.689782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.855746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.868023 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-05551928-a013-4945-bf19-d7e26ade824a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.189900 Aug 07 01:17:41.868775 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 49/113] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:41 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:42.353262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:42.354936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:42.360193 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.361140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.361568 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.362477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.362932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.363351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.537706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:42.542460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:42.552919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:42.553504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:42.553504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:42.553657 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.553808 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-590a4e9a-20bb-48e1-afc8-9bcb0ae85f8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.202995 Aug 07 01:17:42.553947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.555031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.556117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.556772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.557583 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.562492 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 65/114] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:42 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:42.629253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:42.636514 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-19c2e2cb-0508-4020-a1a3-2e400c30e094 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1297 microversion: 2.1 time: 0.099587 Aug 07 01:17:42.637270 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 50/115] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:42 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:42.653648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1301235748", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:42.708362 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] validate_networks() for None {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:42.900786 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:42.901519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:42.907695 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.908311 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.908779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.909666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.910354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.910816 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.027479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:43.028244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:43.028822 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:43.029335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:43.030107 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:43.040323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.040880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.041389 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.042404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.043099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.043741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.063625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Getting quotas for project 58a87d95208a488dac6a1559462c6445. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:43.068698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Getting quotas for user 264ff114924043cb81e271513628e0dd and project 58a87d95208a488dac6a1559462c6445. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:43.088326 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:43.090775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:43.094230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.104719 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d1b957a7-9aaf-4d0a-a282-ec6e5122fa0c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.207817 Aug 07 01:17:43.105443 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 51/116] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:42 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:43.271603 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-010e1981-15a4-4d9c-b19c-10fe1f7a8026 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596320 Aug 07 01:17:43.271603 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 66/117] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:17:43.287788 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6c3939cf-fd8c-442a-bf1d-f3b534df9740 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:43.288850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6c3939cf-fd8c-442a-bf1d-f3b534df9740 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:43.411321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6c3939cf-fd8c-442a-bf1d-f3b534df9740 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.422528 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6c3939cf-fd8c-442a-bf1d-f3b534df9740 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1215 microversion: 2.1 time: 0.138429 Aug 07 01:17:43.423514 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 52/118] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:43 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:43.576105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:43.576988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:43.583359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.583844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.584281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.585142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.585459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.585906 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.656668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:43.657565 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:43.664942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.665698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.666166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.667682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.668445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.669050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.784847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.794690 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8293fa47-6f75-4783-a992-59c257222247 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1297 microversion: 2.1 time: 0.141323 Aug 07 01:17:43.797781 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 53/119] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:43 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:43.811616 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.822789 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.824307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.826560 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a5d481cb-27eb-4f81-abea-dcb4998e3e41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.253778 Aug 07 01:17:43.827122 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 67/120] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:43 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:44.125743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:44.134608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:44.160694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.161390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.170003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.170003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.170003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.170003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.350731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:44.360036 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4a7fbc94-0cef-4b98-8687-7f6834bda6e8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.238091 Aug 07 01:17:44.370881 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 54/121] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:44 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:44.445600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bf99e0a4-725e-4acf-a973-3d45a113f5cb tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:44.446762 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bf99e0a4-725e-4acf-a973-3d45a113f5cb tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:44.548878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-bf99e0a4-725e-4acf-a973-3d45a113f5cb tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:44.557596 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bf99e0a4-725e-4acf-a973-3d45a113f5cb tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1215 microversion: 2.1 time: 0.116947 Aug 07 01:17:44.558718 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 68/122] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:44 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:44.818857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:44.820464 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:44.827615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.830177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.830177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.830177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.830177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.835707 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.852229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:44.862528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:44.863788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.864283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.864721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.865447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.865916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.866339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.933796 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:44.942849 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-95795d63-2308-473e-8569-8d820f7edc27 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1295 microversion: 2.1 time: 0.129224 Aug 07 01:17:44.943435 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 55/123] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:44 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:45.123169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:45.133508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:45.139593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:45.139593 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fa3a3c15-b7d0-44c8-9506-1fab0e4ea465 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.290011 Aug 07 01:17:45.139593 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 69/124] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:44 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:45.301048 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:45.318066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.318066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.318066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.337506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:45.339800 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] Creating event network-changed:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:17:45.360244 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-c6992345-d3f9-4a57-9ddb-c0ad77432e03 req-99acfd0c-5c84-450b-b98f-6675cb833094 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064373 Aug 07 01:17:45.361671 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 56/125] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:45.403787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:45.403787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:45.411073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.411872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.412312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.413032 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.413739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.414324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.449800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:45.579819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:45.582864 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:45.602348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.602874 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.603324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.604055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.604514 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.604948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.772608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:45.772608 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4dee1ef1-8baa-4814-a830-d86311bdc5a5 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1219 microversion: 2.1 time: 0.169582 Aug 07 01:17:45.772608 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 57/126] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:45 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:45.840634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:45.850264 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a8ab09c7-4f57-4147-9b9b-d827aabb8f91 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.458257 Aug 07 01:17:45.851117 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 70/127] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:45 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:45.964957 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:45.965564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:45.971470 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.972532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.972962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.973644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.974352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.974769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.161429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:46.162033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.162399 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:46.172780 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4da69b68-c25b-4da6-b9de-9ea880e18673 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.211537 Aug 07 01:17:46.173372 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 58/128] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:45 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:46.183255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.183855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.184356 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.185162 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.185980 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.188164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.525744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.534124 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.536084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.537240 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3280d048-991e-4811-b71e-fd113dc216b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.381579 Aug 07 01:17:46.537793 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 71/129] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:46.791715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:46.792486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:46.803735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.804704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.805151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.805915 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.806618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.807191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.875885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:46.876724 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:46.884864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.885751 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.886365 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.887254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.887902 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.888471 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.904607 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.915013 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2376d590-dd41-47d6-916d-d460c84fa280 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1267 microversion: 2.1 time: 0.127711 Aug 07 01:17:46.918248 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 59/130] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.195335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.196134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:47.202143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.202629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.203071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.203757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.204205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.204748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.245817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.250129 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-03272f65-c8d8-42b0-bad5-9b149ceabe9c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.378108 Aug 07 01:17:47.250883 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 72/131] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.350198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.358439 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dfec1fac-f120-4742-9c43-21eba99a4576 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.168039 Aug 07 01:17:47.359001 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 60/132] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.465293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd406a7d-ec74-4def-981c-72d0d5d609d0", "tag": "74a6f474-8e6c-4604-83d9-12731ed63e7a"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:47.481797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.484687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.486185 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.520744 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Creating event network-changed:74a6f474-8e6c-4604-83d9-12731ed63e7a for instance bd406a7d-ec74-4def-981c-72d0d5d609d0 on hv-cinder-maste Aug 07 01:17:47.521806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:17:47.523922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-350594c8-eba5-4f90-9a94-ef3fa23e928b req-24ab7d8e-6bad-4bd5-a9aa-5fcb06e89baa service nova] Acquired lock "compute-rpcapi-router" {{(pid=118307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:17:47.523922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.523922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.524194 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.524870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.525309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.525724 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.536732 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.compute.rpcapi [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 01:17:47.537600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] Releasing lock "compute-rpcapi-router" {{(pid=118307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:17:47.554428 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b6c27d97-b92d-4558-bd35-fbdec5aca364 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102892 Aug 07 01:17:47.555252 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 73/133] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:47.560086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.560879 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:47.572752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.572752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.572752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.572752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.573088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.573088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.733181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.742430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.744099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.745209 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b61fb394-9469-4e0a-9fc9-315674b31395 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.189175 Aug 07 01:17:47.745770 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 61/134] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:47.943844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.946251 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:47.950701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.951436 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.951867 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.952604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.953055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.953471 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.032203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.032203 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-011f89cc-ffec-48d4-a4ba-c858bcebc82e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1275 microversion: 2.1 time: 0.093194 Aug 07 01:17:48.032457 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 74/135] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:48.271797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:48.272494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:48.278751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.279301 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.279813 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.280690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.281218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.282087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.379693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:48.380879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:48.387512 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.388272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.388934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.389817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.390726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.391348 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.439202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.456435 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3e004a3d-eead-490b-9214-c987b9c8178b tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.182145 Aug 07 01:17:48.456435 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 62/136] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:48 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:48.564837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.572662 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-969fdb0b-d761-422f-b946-4c46fa4044a9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.196988 Aug 07 01:17:48.573232 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 75/137] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:48 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:48.772591 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:48.773227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:48.779752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.780231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.780667 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.781355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.781799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.782387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.941742 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.952974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.954670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.956609 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7810123b-6d94-4e18-af8b-bba443f933d8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.189330 Aug 07 01:17:48.975077 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 63/138] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:48 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:49.054718 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.055352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.061862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.062338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.062767 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.063482 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.063961 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.064453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.073155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee88aad-cfc0-4271-a6b1-95aeb473bf0d", "name": "network-vif-plugged", "status": "completed", "tag": "db0b25ff-15e1-457a-9dbd-6722a5426fad"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:49.083596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.084067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.084488 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.096222 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] Creating event network-vif-plugged:db0b25ff-15e1-457a-9dbd-6722a5426fad for instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d on hv-cinder-maste Aug 07 01:17:49.101914 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-b45fa61e-ebcf-4738-a010-ca178fc7f2df req-27e430da-638f-46e8-92f8-8a0a3e83a105 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100200 Aug 07 01:17:49.102510 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 76/139] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:49.130013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.137694 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a541e127-5bca-4fa0-be20-23b1e07df5f9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1275 microversion: 2.1 time: 0.086925 Aug 07 01:17:49.138289 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 64/140] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:49.480717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.481403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.488452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.489126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.489542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.490688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.491143 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.491559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.595102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.595102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.601825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.602342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.602776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.603635 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.604167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.604649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.641014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.645515 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c8820bd0-0b47-4d7e-a8ac-0daec58563d4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.173932 Aug 07 01:17:49.646106 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 77/141] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:49.800772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.808329 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f75b03d5-e953-4767-b89f-76011430f51c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.218801 Aug 07 01:17:49.809387 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 65/142] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:49.982474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.983169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.001663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.006053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.006699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.008262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.008934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.009788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.158544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:50.159428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.165335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.165809 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.166266 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.166950 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.167392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.167807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.181543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.189627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.192839 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.194126 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8909b06a-4a4a-4bae-98c1-e89bb7eabaed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.216115 Aug 07 01:17:50.194690 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 78/143] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:50.230190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.237669 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a031ea7d-b6a5-4793-b5d2-b18d3d2c4ea0 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1275 microversion: 2.1 time: 0.082899 Aug 07 01:17:50.238246 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 66/144] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:50 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:50.665361 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:50.666589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.672611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.673085 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.673509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.676799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.677256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.677678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.832689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:50.834723 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.842116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.842970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.843579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.845066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.845711 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.846867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.947835 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.959263 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-25ecfe67-f75b-4e61-85fb-04acb2279949 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.297711 Aug 07 01:17:50.970029 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 79/145] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:50 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:51.140739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:51.151485 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4fe4e87a-f0e5-4232-9778-e60e14257e2c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.325338 Aug 07 01:17:51.152073 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 67/146] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:50 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:51.218229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:51.218940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:51.226633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.227511 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.228109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.228970 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.229565 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.230432 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.258169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:51.258818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:51.275320 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.278709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.282892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.282892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.282892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.282892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.377304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:51.387096 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9ab5eafe-ef31-4e68-becb-a1f4100dae8f tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1273 microversion: 2.1 time: 0.132474 Aug 07 01:17:51.388288 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 68/147] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:51 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:51.897121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:51.906392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:51.908277 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:51.910370 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8b375bb8-6eac-4e20-9a0a-6256121d2d4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.696028 Aug 07 01:17:51.911291 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 80/148] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:51 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:51.991517 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:51.992130 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:51.998171 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.998651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.999082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.999768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.000212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.000831 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.174891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.175669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:52.180028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.185394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.186309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.188490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.189453 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.190834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.193449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.194505 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c78c44fb-b90a-483e-918f-422acc521675 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.206935 Aug 07 01:17:52.195094 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 69/149] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:51 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.411109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.411949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:52.418524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.419241 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.420307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.421162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.421755 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.422333 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.532628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.542783 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47f00a2b-6bca-47bc-aa2d-2cd0c302fbde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.373403 Aug 07 01:17:52.544574 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 81/150] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.629519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.642585 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4a53a35f-a4b3-4e16-89cc-ecf23a40f12d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.236100 Aug 07 01:17:52.644513 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 70/151] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.747936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "name": "network-vif-plugged", "status": "completed", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:52.753328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.754021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.754538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.772888 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] Creating event network-vif-plugged:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:17:52.778990 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-db435ea9-0d3f-41a9-95dc-cb3dbde1ab1d req-bce37524-0a70-41bf-afa3-40d8f99bc9d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049848 Aug 07 01:17:52.780002 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 82/152] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:17:52.953678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.954307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:52.960563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.960824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.961241 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.961965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.962400 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.962815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.216773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:53.217635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:53.228350 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.228834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.229265 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.229987 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.233878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.234343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.370026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.383303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.384981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.386198 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-50fd0cdc-1bd2-4774-922c-d417c56d17e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.437400 Aug 07 01:17:53.386692 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 71/153] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:53.512717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.527379 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3fcb010c-153c-4fc8-ad66-5bb877bb82c4 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.314827 Aug 07 01:17:53.528515 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 83/154] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:53 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:53.567387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:53.573782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:53.574429 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:53.585046 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.585858 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.586372 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.587175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.587834 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.588247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.682168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:53.682168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:53.682168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.682168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.682656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.682656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.682656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.682656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.751848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.759816 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0d5c1b35-a6cf-4ddb-848c-3c0ff1674efe tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.194573 Aug 07 01:17:53.760391 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 72/155] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:53 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:53.809699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.818887 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f01e6aad-8dd3-4c67-a0d6-8652a827a1a4 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.157612 Aug 07 01:17:53.819543 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 84/156] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:53 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:54.289550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d91b98-dbe1-47f9-984f-6beb448e8ca8", "tag": "a8996667-3c7f-4ee6-a79a-424699fa9128"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:54.299734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.300466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.301203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.312997 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] Creating event network-changed:a8996667-3c7f-4ee6-a79a-424699fa9128 for instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 on hv-cinder-maste Aug 07 01:17:54.318565 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-55583d39-4565-460c-a9df-32dda52833cb req-96213835-e6ba-4a9f-bcc3-d4e993650a73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032666 Aug 07 01:17:54.319941 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 73/157] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:54.412323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.413100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.419010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.419486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.419913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.420588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.421032 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.421447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.550447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.551139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.553972 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.556283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:54.557451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.558068 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.558558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.559307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.559839 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.560311 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.562653 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.564175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.564381 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:54.565668 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eed40f94-48ad-4628-89f7-92c3ddaa160b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.157334 Aug 07 01:17:54.566271 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 85/158] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:54.713543 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.726475 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c3dfe864-977c-446f-bb47-e6a0cf05844e tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.180715 Aug 07 01:17:54.727770 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 74/159] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:54.781254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.781900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.788962 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.789454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.789968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.790655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.791268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.791704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.839989 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.840647 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.847363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.847840 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.848263 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.848949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.849386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.849850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.019229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.031141 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7ded2eb7-c9e5-4887-9e40-51b2d174ee88 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.253599 Aug 07 01:17:55.031721 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 86/160] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:55.062953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.073571 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1c484eed-742c-4be8-85e2-883ba725e1cd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.237849 Aug 07 01:17:55.074370 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 75/161] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:55.591095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.592495 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:55.601708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.602422 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.602633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.603320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.604217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.604637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.747023 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.747612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:55.754118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.754600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.755207 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.755748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.755901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.756340 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.756760 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.764206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.765802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.766935 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d21a755-ab67-4e8d-8e15-c68d1fd8fb76 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.180553 Aug 07 01:17:55.767503 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 87/162] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:55.924617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.933147 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8000af83-7afd-4bfb-95e7-4bfb42dcdccb tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1315 microversion: 2.1 time: 0.189903 Aug 07 01:17:55.934379 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 76/163] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:56.052618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.053221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:56.062276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.062276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.062276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.062276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.062598 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.062598 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.081621 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:56.101658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.102604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:56.115202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.119507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.120023 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.122713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.123224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.129853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.334218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:56.335116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:56.342152 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6fb51f83-02ca-43f4-9743-c8c29fd4de75 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.293429 Aug 07 01:17:56.347539 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 88/164] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:56.347680 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fa8dcf65-7406-49d2-8472-33688b0efaa3 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.247319 Aug 07 01:17:56.347680 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 77/165] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:56.792629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.793233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:56.800782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.801280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.802020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.802734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.803258 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.803714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.954929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.966011 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:56.982983 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.983748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.984436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.985312 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.986074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.986557 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.017938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.026220 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.030891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.030891 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fc626dc4-a54e-4f47-b40f-50b72e771fe0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.241971 Aug 07 01:17:57.030891 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 89/166] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:57.133202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.141877 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-58f1193b-3811-400e-b701-0ea536216e6d tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1501 microversion: 2.1 time: 0.192042 Aug 07 01:17:57.144055 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 78/167] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:57.366173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:57.374797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:57.374797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.375061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:57.375149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.375496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:57.375936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.377225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.377877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.378409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.389280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.390180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.391000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.392313 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.394242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.395338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.535196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:57.753908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.767478 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8d1e5c99-1234-4e76-a7ed-67bf78525286 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.404986 Aug 07 01:17:57.772154 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 90/168] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:57 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:57.775899 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.785340 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-726bd260-1178-41e6-801e-6716fef6986c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.421209 Aug 07 01:17:57.787021 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 79/169] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:57 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:58.052003 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:58.053540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:58.061355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.062707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.063497 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.064542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.065239 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.066053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.334899 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:58.342970 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:58.344599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:58.345736 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4249fee5-717c-494d-9ed1-5a3d482378b7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1406 microversion: 2.20 time: 0.298737 Aug 07 01:17:58.346324 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 91/170] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:58 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:58.789217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:58.790018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:58.806601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.806601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.806601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.806601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.806942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.806942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.817026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:58.817790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:58.829327 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.829994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.830510 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.832510 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.836180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.836731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.032377 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.043486 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5c19e82f-e022-49c6-8435-7156e17392dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.234560 Aug 07 01:17:59.050294 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 92/171] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:58 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:59.122304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.148340 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2b3a5b61-d975-4f6b-8454-8eaccb547d85 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.363200 Aug 07 01:17:59.149153 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 80/172] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:58 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:59.375391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:59.376036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:59.388454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.389021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.389656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.390427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.393443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.394119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.624942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.634010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.635585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.636766 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0e49ce26-a27c-4e92-9423-bd0b0e2d949c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1599 microversion: 2.20 time: 0.266091 Aug 07 01:17:59.637328 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 93/173] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:59 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1599 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:17:59.660563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:59.661047 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:59.666924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.667408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.667838 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.668555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.669002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.669422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.783414 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7c48eacc-a4fa-4155-9e47-8804bedfe3a2 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127357 Aug 07 01:17:59.784013 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 81/174] 10.222.0.36 () {60 vars in 1316 bytes} [Sun Aug 7 01:17:59 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:17:59.945912 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b1c8748-ac07-4d92-9d3c-4ee4bd35e5c9"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:59.956460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:59.970317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.971394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.971829 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.972535 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.972980 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.973480 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.065790 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:00.067348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:00.073954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:00.074664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:00.075253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.076367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:00.077112 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:00.077679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.374626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:00.382302 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1a3c2c82-1b4b-4098-85d0-62896fe6dade tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.321166 Aug 07 01:18:00.396201 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 82/175] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:00 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:00.396201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:00.396201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:00.396201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:00.396201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:00.396747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.396747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:00.396747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:00.396747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.772741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:00.780347 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-81199883-d745-4a1f-b607-f60ce8e7b756 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.396426 Aug 07 01:18:00.793865 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 83/176] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:00 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:01.023057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd406a7d-ec74-4def-981c-72d0d5d609d0", "name": "network-vif-plugged", "status": "completed", "tag": "74a6f474-8e6c-4604-83d9-12731ed63e7a"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:01.034208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.035794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.036432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:01.051648 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] Creating event network-vif-plugged:74a6f474-8e6c-4604-83d9-12731ed63e7a for instance bd406a7d-ec74-4def-981c-72d0d5d609d0 on hv-cinder-maste Aug 07 01:18:01.057805 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-ec314e06-6af2-4af7-b2b2-a5709810df68 req-e498ad1f-b4ac-481c-ae6e-e67d3c58fa14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038754 Aug 07 01:18:01.059386 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 84/177] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:18:01.413329 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:01.414441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:01.427692 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.428191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.430167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:01.431136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.431762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.432342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:01.754490 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:01.765412 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-47ece2a1-b59b-4daa-8a54-ee1ff10fd392 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.364382 Aug 07 01:18:01.766322 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 85/178] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:01 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:01.819148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:01.819148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:01.819148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.821413 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.823902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:01.826822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.831157 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.831868 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.015762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:02.023632 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c85c6501-df8c-45c6-9a93-cb2190daccf6 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.222624 Aug 07 01:18:02.024201 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 86/179] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:01 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:02.085696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:02.090784 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:02.096441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.096922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.097379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.108865 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] Creating event network-changed:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:18:02.114258 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-28b1c758-36e7-49ef-8ac4-ca77a2166f33 req-7435e975-8bd5-4420-9da3-f6fa00339968 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087159 Aug 07 01:18:02.114869 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 87/180] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:02.171414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1966004438", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "e8798268-8d54-4e5b-88d2-6c7c5b0cdadc"}]}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:02.232499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] validate_networks() for [('e8798268-8d54-4e5b-88d2-6c7c5b0cdadc', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:02.629591 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:02.630148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:02.630508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:02.631530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:02.632205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:02.644105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.644596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.645074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.645866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.646501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.647122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.690159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Getting quotas for project 95d307b5c73647b99396f19bc7ef676b. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:02.695434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Getting quotas for user 181870dc52884c3da93545754cded2b6 and project 95d307b5c73647b99396f19bc7ef676b. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:02.713201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:02.715743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:02.894249 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-09e3cfe4-fb7d-4869-8410-e46aef2c88a0 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776126 Aug 07 01:18:02.895143 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 88/181] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:02.910288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:02.913745 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:02.929815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.929815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.933981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.934861 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.936648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.939092 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.149588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:03.162118 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5043629b-bafb-4e0e-91e1-b436706a6aa4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.265116 Aug 07 01:18:03.163070 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 89/182] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:02 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:03.182883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f0771480-fd01-4ace-8cb8-a2bbf1fd1e95 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:03.185407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f0771480-fd01-4ace-8cb8-a2bbf1fd1e95 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:03.258006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f0771480-fd01-4ace-8cb8-a2bbf1fd1e95 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:03.266517 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f0771480-fd01-4ace-8cb8-a2bbf1fd1e95 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1214 microversion: 2.1 time: 0.102228 Aug 07 01:18:03.280561 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:03 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:03.280561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:03.280561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:03.287348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.288035 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.288578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.289726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.289991 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.290511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.542580 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ae2622c4-3e54-4b00-a9b8-219e09200a8f tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "POST /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.598091 Aug 07 01:18:03.546181 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 94/184] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:17:59 2022] POST /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d/os-volume_attachments => generated 194 bytes in 3610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:03.590245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:03.598700 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-33c15285-cf36-4d67-be54-3eae4d93b188 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.329181 Aug 07 01:18:03.599635 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:03 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:04.184908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.185540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:04.188529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:04.192689 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.193169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.193602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.194330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.194782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.195202 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.288915 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ab499f7f-812f-455a-966b-7a2b5bd4cc81 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.289792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ab499f7f-812f-455a-966b-7a2b5bd4cc81 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:04.344662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:04.353682 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-93171adf-c212-40e1-80e4-2196be15af25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.173518 Aug 07 01:18:04.366247 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:04.372252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ab499f7f-812f-455a-966b-7a2b5bd4cc81 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:04.379899 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ab499f7f-812f-455a-966b-7a2b5bd4cc81 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1214 microversion: 2.1 time: 0.095924 Aug 07 01:18:04.382355 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 92/187] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:04.619950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.623206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:04.626963 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.627452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.628081 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.628752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.629202 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.629619 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.834797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:04.842278 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5616e074-79f1-4fa8-b26a-a3d193d205ce tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.226106 Aug 07 01:18:04.842873 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.296474 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d91b98-dbe1-47f9-984f-6beb448e8ca8", "name": "network-vif-plugged", "status": "completed", "tag": "a8996667-3c7f-4ee6-a79a-424699fa9128"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:05.306997 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.307472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.307897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.320862 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] Creating event network-vif-plugged:a8996667-3c7f-4ee6-a79a-424699fa9128 for instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 on hv-cinder-maste Aug 07 01:18:05.326109 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-bd40a062-5850-4b59-bbbb-3e363325a65d req-02bfdb5e-126c-4aa2-b601-cdea3009bc63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Aug 07 01:18:05.326705 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 93/189] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:05.375014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.375615 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.383100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.383580 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.384004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.384690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.385134 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.385551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.401721 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.402689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.413123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.413768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.414237 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.416738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.416738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.416738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.488927 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.496665 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-814150ba-d39e-4985-8185-8cc346a5c43b tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1210 microversion: 2.1 time: 0.099217 Aug 07 01:18:05.497278 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 94/190] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.540933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.549796 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-baa3daf2-8a1f-49d1-b026-29753c53b991 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1363 microversion: 2.1 time: 0.179085 Aug 07 01:18:05.550401 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 97/191] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.864109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.864719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.870699 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.871175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.871630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.872305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.872823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.873243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.009804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:06.013815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:06.018581 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e0404547-cf9e-4f36-88d9-352cd318ec88 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.159037 Aug 07 01:18:06.019148 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 95/192] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:06.518059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:06.519188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:06.526563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.527159 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.527621 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.528307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.528754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.529170 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.580775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:06.582108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:06.589074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.590069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.590701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.591667 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.592346 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.592843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.606267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:06.615382 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-17690feb-a7a7-4c0d-81b9-9a74a041402f tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1210 microversion: 2.1 time: 0.100826 Aug 07 01:18:06.616694 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 98/193] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:06 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:06.744881 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:06.753067 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-29d40b48-5ca3-4912-80e1-f1bbdb56f89b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1550 microversion: 2.1 time: 0.177596 Aug 07 01:18:06.753629 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 96/194] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:06 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:06.775783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:06.776273 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:06.782254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.782794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.783288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.784045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.784508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.784929 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.888045 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d619a2ba-fdd5-4897-bc42-c4e93ecb40e4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116055 Aug 07 01:18:06.889124 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 99/195] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:18:06 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:07.039238 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.039847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:07.046228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.046886 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.047513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.048971 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.050344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.051211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.186285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.194374 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b8008007-2d13-4fed-8b99-93d82e2956fc tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.158945 Aug 07 01:18:07.195038 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 97/196] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:07.637550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.639473 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:07.646202 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.646690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.647122 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.647811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.648259 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.648678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.712642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.720593 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ca1ea38a-527a-4ef2-b655-17b53c3320ec tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1266 microversion: 2.1 time: 0.087089 Aug 07 01:18:07.723868 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 100/197] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.215335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.215993 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:08.222449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.222947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.223414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.224145 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.224687 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.225040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.372706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.382428 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-62ac51c7-3d24-4203-918a-c4e65eccc948 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.170993 Aug 07 01:18:08.391221 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 98/198] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.551744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd406a7d-ec74-4def-981c-72d0d5d609d0", "tag": "74a6f474-8e6c-4604-83d9-12731ed63e7a"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:08.566341 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.566881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.567324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.578796 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] Creating event network-changed:74a6f474-8e6c-4604-83d9-12731ed63e7a for instance bd406a7d-ec74-4def-981c-72d0d5d609d0 on hv-cinder-maste Aug 07 01:18:08.584246 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-1f28bcc9-a7ec-488a-b4ea-6706bd3b09b8 req-d3a943d3-5b75-4274-aedc-bf0e673c0fa7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040265 Aug 07 01:18:08.584848 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 101/199] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:08.742990 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.743611 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:08.751828 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.752750 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.753373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.754204 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.754665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.755173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.832015 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.839752 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-30ef049a-0e2d-45b7-a989-e00b8e7c1c28 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1274 microversion: 2.1 time: 0.100523 Aug 07 01:18:08.840357 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 99/200] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:09.138747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.139944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.148636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.149130 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.149599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.150537 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.150983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.151400 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.198952 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:09.405180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.406415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.419807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.420450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.421074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.422044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.423596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.424258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.629587 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:09.651361 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e99da488-d4fb-4f1b-bfe8-962f3ca512df tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1315 microversion: 2.1 time: 0.250184 Aug 07 01:18:09.655468 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 100/201] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:09 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:09.676410 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ba43cdbc-d683-44c8-87ae-401213de111c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 204 len: 0 microversion: 2.1 time: 0.542822 Aug 07 01:18:09.680835 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 102/202] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:09 2022] DELETE /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:09.689325 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.690270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.697439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.697995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.698437 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.699243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.699861 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.700518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.870193 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.873478 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.896175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.898037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.899483 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.901508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.902385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.904460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.909974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:09.915055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:09.930949 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa38e5e1-4469-4856-8b81-0d6e024adda2 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1553 microversion: 2.1 time: 0.248466 Aug 07 01:18:09.931896 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 101/203] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:09 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:10.116491 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.132084 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-80e267aa-bb1b-49d9-9caa-92d5232d6bae tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.274397 Aug 07 01:18:10.132699 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 103/204] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:09 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:10.672475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:10.673244 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:10.679447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.683652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.683652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.683652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.683652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.684005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.815466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.823476 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-212ae211-0c0f-45cc-ac91-775e0cda4024 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1465 microversion: 2.1 time: 0.154886 Aug 07 01:18:10.824099 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 102/205] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:10 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:10.871741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:10.872240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:10.879775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.880259 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.880692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.881372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.881821 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.882263 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.907869 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:10.952439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:10.953043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:10.960157 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.960715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.961620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.962361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.962999 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.963417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.108491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:11.117810 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-570bde6a-60dc-4362-8261-187077acb174 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1553 microversion: 2.1 time: 0.169441 Aug 07 01:18:11.118753 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 103/206] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:10 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:11.154418 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:11.154963 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:11.161715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.165389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.165389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.165389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.165389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.165709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.232572 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-611e0a92-4c67-4c7d-b8f5-52851158f66d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 204 len: 0 microversion: 2.1 time: 0.364772 Aug 07 01:18:11.233171 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 104/207] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:10 2022] DELETE /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:11.243759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:11.244404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:11.250824 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.252160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.252811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.253719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.254339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.255248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.300209 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:11.315886 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c1a806c0-1c4d-4e56-bb63-269c3d5798da tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.165315 Aug 07 01:18:11.317872 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 104/208] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:11 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:11.404346 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:11.413058 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2e8a89e8-69f0-40b1-bb08-3fa7e607c8dd tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1471 microversion: 2.1 time: 0.173494 Aug 07 01:18:11.413604 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 105/209] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:11 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:12.138542 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:12.139166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:12.145580 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.146092 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.146522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.147199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.147648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.148063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.319189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:12.328500 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-050d016e-03e3-4a8f-867f-993c991fe0f8 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1553 microversion: 2.1 time: 0.193496 Aug 07 01:18:12.329885 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 105/210] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:12 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:12.345358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:12.346094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:12.353645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.360086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.360086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.360086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.360086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.361047 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.434331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:12.436485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:12.442065 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.442542 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.442974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.443667 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.444292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.444716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.530240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:12.541471 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8cdaf019-88da-4d83-8d7c-95727146856c tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.200539 Aug 07 01:18:12.542201 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 106/211] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:12 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:12.587005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:12.595099 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9ca34d2f-f01a-40e8-a0e8-f27c33ccf908 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1471 microversion: 2.1 time: 0.164040 Aug 07 01:18:12.601214 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 106/212] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:12 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:12.930722 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64737288-e1eb-42db-9dad-e4f348012034", "tag": "3a98b7c2-7dec-476f-b6f9-736ae17cf447"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:12.940993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.941481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.942062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.953436 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] Creating event network-changed:3a98b7c2-7dec-476f-b6f9-736ae17cf447 for instance 64737288-e1eb-42db-9dad-e4f348012034 on hv-cinder-maste Aug 07 01:18:12.958358 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-55d89c37-6ffb-4ae5-9d60-65c312897f48 req-26d31dc3-d2d9-4bc2-839d-2ae8503ee217 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031268 Aug 07 01:18:12.959096 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 107/213] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:13.350570 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:13.351178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:13.352999 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:13.357726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.358245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.358693 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.359356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.359805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.360246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.490166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:13.498530 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-29db6531-8de7-4b3b-8449-0274d7f4dfb3 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1553 microversion: 2.1 time: 0.151767 Aug 07 01:18:13.499103 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 107/214] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:13 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:13.569502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:13.570221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:13.577059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.577531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.577991 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.578669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.579115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.579527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.616463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:13.634702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:13.634702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.634702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.634702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.635062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.635062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.635062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.734095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:13.734095 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-360887b4-d935-4fdb-a84b-6525df041639 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.154849 Aug 07 01:18:13.734095 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 108/215] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:13 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:13.762293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:13.770228 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5b1dde0e-37c4-4fb9-b186-5ad307abf7c8 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1471 microversion: 2.1 time: 0.157586 Aug 07 01:18:13.770799 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 108/216] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:13 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:14.520536 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.521155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.527468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.527954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.528388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.529080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.529707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.530297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.728791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.736817 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2e5e5430-d8eb-4121-bce3-0962c023901a tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1553 microversion: 2.1 time: 0.220617 Aug 07 01:18:14.737313 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 109/217] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:14.740494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.741099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.743256 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=10 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:14.747974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.748448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.748874 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.749546 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.750029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.750448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.797272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.798289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.806913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.807583 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.808223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.808940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.809542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.810010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.127975 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:15.135317 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e9a61855-80ce-4e8d-a9b1-b9e2f4d6cde7 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.398615 Aug 07 01:18:15.136081 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 109/218] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:15.220244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:15.228581 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c934d8c3-4686-4829-9607-c2dcba3ddf0e tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1471 microversion: 2.1 time: 0.437581 Aug 07 01:18:15.229519 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 110/219] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:15.680822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d91b98-dbe1-47f9-984f-6beb448e8ca8", "name": "network-vif-deleted", "tag": "a8996667-3c7f-4ee6-a79a-424699fa9128"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:15.691657 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.692141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.693331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.705536 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] Creating event network-vif-deleted:a8996667-3c7f-4ee6-a79a-424699fa9128 for instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 on hv-cinder-maste Aug 07 01:18:15.715792 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-80111fe5-e8c9-4571-a073-ee7809cd4b1a req-cb5fd01f-e419-4be9-aaf9-0ad298fdb618 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038610 Aug 07 01:18:15.716728 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 110/220] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:15.759205 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:15.760012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:15.774414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.778333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.778801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.779892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.802331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.803625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.957935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:15.967477 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7a6609aa-3590-407c-9b27-85303e71cd73 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1511 microversion: 2.1 time: 0.213917 Aug 07 01:18:15.968605 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 111/221] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:15 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:16.048036 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee88aad-cfc0-4271-a6b1-95aeb473bf0d", "name": "network-vif-deleted", "tag": "db0b25ff-15e1-457a-9dbd-6722a5426fad"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:16.064862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.067563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.069573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.084079 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] Creating event network-vif-deleted:db0b25ff-15e1-457a-9dbd-6722a5426fad for instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d on hv-cinder-maste Aug 07 01:18:16.090027 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-152ea8e3-bc01-4b42-a0a2-59a492f23d2b req-da858d30-aac7-4f36-8ee2-c5b707b41885 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046085 Aug 07 01:18:16.095444 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 111/222] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:16.158119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:16.159131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:16.165603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.166617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.167321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.168094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.168614 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.169106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.250408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:16.251693 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:16.259252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.260286 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.260887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.261630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.262119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.262547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.300103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.300591 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.301055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.301579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lazy-loading 'fault' on Instance uuid 59d91b98-dbe1-47f9-984f-6beb448e8ca8 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:16.351689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:16.364146 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3d534eb2-331c-474c-9304-29b345bc4577 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1305 microversion: 2.1 time: 0.119091 Aug 07 01:18:16.377582 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 112/223] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:16 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:16.573859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:16.583318 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-51f05dc8-e74e-4abb-b155-ab2f3a3f8501 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.430307 Aug 07 01:18:16.584051 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:16 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:17.001010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:17.001735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:17.008391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.008877 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.009332 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.010175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.010787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.011212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.030696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:17.043361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.043843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.044275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.044875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lazy-loading 'fault' on Instance uuid 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:17.089038 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:17.098637 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa9a3fdf-02dc-4663-8e7c-e95fe1df7f98 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1351 microversion: 2.1 time: 0.101946 Aug 07 01:18:17.099329 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 113/225] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:16 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:17.385919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:17.386532 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:17.393233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.393770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.394223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.394912 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.395358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.395778 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.427113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.427585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.428015 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.428465 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lazy-loading 'fault' on Instance uuid 59d91b98-dbe1-47f9-984f-6beb448e8ca8 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:17.472115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:17.479693 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20e4f590-81b1-4ff8-8103-bc42d81b6186 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1305 microversion: 2.1 time: 0.097640 Aug 07 01:18:17.480264 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 113/226] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:17 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:17.604925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:17.605530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:17.612289 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.612764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.613193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.614014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.614477 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.614875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.743853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:17.751266 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4c2401bb-9fca-4e5b-8fef-77817dd556fa tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.150182 Aug 07 01:18:17.751828 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 114/227] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:17 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:18.119877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:18.120623 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:18.127226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.131267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.131267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.131267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.131267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.131632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.163675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.164176 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.165635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.165635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lazy-loading 'fault' on Instance uuid 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:18.209747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.217948 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-951c9901-68c8-4b17-be63-af689c6c0bc0 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1351 microversion: 2.1 time: 0.102130 Aug 07 01:18:18.222387 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 114/228] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:18 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:18.501920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:18.502559 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:18.508739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.509560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.516926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.516926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.516926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.516926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.546223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.546637 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.547074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.547519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lazy-loading 'fault' on Instance uuid 59d91b98-dbe1-47f9-984f-6beb448e8ca8 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:18.589247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ff114924043cb81e271513628e0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a87d95208a488dac6a1559462c6445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.597119 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bc224f0b-e670-481e-a145-4723176674d9 tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 200 len: 1305 microversion: 2.1 time: 0.100103 Aug 07 01:18:18.597641 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 115/229] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:18 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:18.772078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:18.773206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:18.780281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.780281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.780613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.781306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.782324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.782933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.910419 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.918063 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9c3e0898-1b8e-4605-b1e2-31a503a4e196 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.149935 Aug 07 01:18:18.918636 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 115/230] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:18 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:19.251387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:19.252015 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:19.264438 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.270520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.271178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.272097 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.272710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.273289 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.324542 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.325253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.326209 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.326907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lazy-loading 'fault' on Instance uuid 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:19.413603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f270593db29b4835952de74f591011c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a4367254cc4a318f7abe3a16821bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:19.438110 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0bf81151-53d5-4061-bf13-6ecfee0109cc tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 200 len: 1351 microversion: 2.1 time: 0.197012 Aug 07 01:18:19.438110 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 116/231] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:19 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 1351 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:19.616956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:19.617567 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] [instance: 59d91b98-dbe1-47f9-984f-6beb448e8ca8] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:19.626667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.626667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.626667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.626667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.626977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.626977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.646056 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] HTTP exception thrown: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Request method failure captured: Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 HTTP/1.1 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKzTyD94GdQxBpqI2Zz9ALlcNUr2OouNtQMIDA-xj9NfBAY4RvUAzgIkxSyiFBkXa6tfFvi4zdmP43RqerEdS9AiKPZO1AduIx7QErQe7hVhBQOGukjSQXmUyuOoN8njC1xYuCaThL62Ni5-dGtNm1k_5kSHWYQD9ojrGmRzQwnOBk Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 58a87d95208a488dac6a1559462c6445 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1235572885 Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:18:19.650865 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/58a87d95208a488dac6a1559462c6445"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58a87d95208a488dac6a1559462c6445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58a87d95208a488dac6a1559462c6445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_58a87d95208a488dac6a1559462c6445", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1235572885 Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 58a87d95208a488dac6a1559462c6445 Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1235572885 Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1235572885-project Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 264ff114924043cb81e271513628e0dd Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1235572885-project Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. Aug 07 01:18:19.652197 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '59d91b98-dbe1-47f9-984f-6beb448e8ca8'} Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:19.652869 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. Aug 07 01:18:19.654851 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:19.655812 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] Returning 404 to user: Instance 59d91b98-dbe1-47f9-984f-6beb448e8ca8 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:19.655812 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d3103e64-b926-4f6f-8386-c5812b5f0f7d tempest-VolumesNegativeTest-1235572885 tempest-VolumesNegativeTest-1235572885-project] 10.222.0.36 "GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8" status: 404 len: 111 microversion: 2.1 time: 0.039280 Aug 07 01:18:19.655812 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 116/232] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:19 2022] GET /compute/v2.1/servers/59d91b98-dbe1-47f9-984f-6beb448e8ca8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:19.940833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:19.942618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:19.958821 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.959659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.960417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.961917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:19.962479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:19.963080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:20.179576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:20.188517 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8b8f9511-d01a-482c-af79-6271a5f57e32 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.251374 Aug 07 01:18:20.189727 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 117/233] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:19 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:20.458553 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:20.459351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:20.465977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:20.466464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:20.466894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:20.469010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:20.469010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:20.469010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:20.485146 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] HTTP exception thrown: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Request method failure captured: Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d HTTP/1.1 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKS06hQiyKpo-agUWUY3IRqN9Ke2YC7gpIfo1DTGRXlzl1MqjdaUg3PXfa2wAoJP7dt4-D4lpAssZGwIjL2ZPqCX8POAwFXLD2T-yraqSAysRmJzoSv6rYUK2ZMnnCAivtQ1-oBH9A9FCnu_UWDnIj0EhspUrD-kWlFY2jUQ0GgAT8 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:18:20.486868 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90a4367254cc4a318f7abe3a16821bf8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: f270593db29b4835952de74f591011c5 Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.492881 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '8ee88aad-cfc0-4271-a6b1-95aeb473bf0d'} Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:20.493723 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.494808 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.495783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Returning 404 to user: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:20.495783 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-abd36c9a-2351-4b00-a353-975e504fbf51 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 404 len: 111 microversion: 2.1 time: 0.033707 Aug 07 01:18:20.495783 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 117/234] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:20 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:20.624538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:20.626709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:20.632548 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:20.633028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:20.633458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:20.634170 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:20.634611 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:20.635196 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:20.648527 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] HTTP exception thrown: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Request method failure captured: Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d/os-volume_attachments HTTP/1.1 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKS06hQiyKpo-agUWUY3IRqN9Ke2YC7gpIfo1DTGRXlzl1MqjdaUg3PXfa2wAoJP7dt4-D4lpAssZGwIjL2ZPqCX8POAwFXLD2T-yraqSAysRmJzoSv6rYUK2ZMnnCAivtQ1-oBH9A9FCnu_UWDnIj0EhspUrD-kWlFY2jUQ0GgAT8 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:18:20.652749 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90a4367254cc4a318f7abe3a16821bf8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: f270593db29b4835952de74f591011c5 Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.653962 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'server_id': '8ee88aad-cfc0-4271-a6b1-95aeb473bf0d'} Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:20.654658 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:20.655744 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:20.657614 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Returning 404 to user: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:20.657614 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1efc2f7b-b442-415c-9ed5-37b6b67643b6 tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033615 Aug 07 01:18:20.657614 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 118/235] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:18:20 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:21.210891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:21.211507 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:21.218411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:21.218925 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:21.219370 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:21.220110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:21.220506 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:21.220922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:21.364511 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:21.376937 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b7d6dc24-6638-41ba-bf41-682d44662b23 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.169835 Aug 07 01:18:21.390089 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 118/236] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:21 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:21.407505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64737288-e1eb-42db-9dad-e4f348012034", "name": "network-vif-plugged", "status": "completed", "tag": "3a98b7c2-7dec-476f-b6f9-736ae17cf447"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:21.419973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:21.420374 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:21.420801 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:21.433066 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] Creating event network-vif-plugged:3a98b7c2-7dec-476f-b6f9-736ae17cf447 for instance 64737288-e1eb-42db-9dad-e4f348012034 on hv-cinder-maste Aug 07 01:18:21.438902 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-a5886ab8-5dcd-46e7-8008-410c22c40ab8 req-18f8cb57-12a2-42b6-bcfb-2001c0944733 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035164 Aug 07 01:18:21.439505 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 119/237] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:18:22.166985 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:22.167831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:22.176046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.176734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.177632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.178367 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.178818 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.180957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.199515 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] HTTP exception thrown: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Request method failure captured: Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d HTTP/1.1 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKS06hQiyKpo-agUWUY3IRqN9Ke2YC7gpIfo1DTGRXlzl1MqjdaUg3PXfa2wAoJP7dt4-D4lpAssZGwIjL2ZPqCX8POAwFXLD2T-yraqSAysRmJzoSv6rYUK2ZMnnCAivtQ1-oBH9A9FCnu_UWDnIj0EhspUrD-kWlFY2jUQ0GgAT8 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:18:22.202455 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90a4367254cc4a318f7abe3a16821bf8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: f270593db29b4835952de74f591011c5 Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.203788 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '8ee88aad-cfc0-4271-a6b1-95aeb473bf0d'} Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:22.204550 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.205554 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.207954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Returning 404 to user: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:22.209128 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ea936a86-61aa-444c-8530-b8794dca35ca tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 404 len: 111 microversion: 2.1 time: 0.045960 Aug 07 01:18:22.209944 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 119/238] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:22 2022] DELETE /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:22.223973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:22.224675 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] [instance: 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:22.231563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.232049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.232589 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.233287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.235718 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.236228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.252844 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] HTTP exception thrown: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Request method failure captured: Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d HTTP/1.1 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKS06hQiyKpo-agUWUY3IRqN9Ke2YC7gpIfo1DTGRXlzl1MqjdaUg3PXfa2wAoJP7dt4-D4lpAssZGwIjL2ZPqCX8POAwFXLD2T-yraqSAysRmJzoSv6rYUK2ZMnnCAivtQ1-oBH9A9FCnu_UWDnIj0EhspUrD-kWlFY2jUQ0GgAT8 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:18:22.255221 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90a4367254cc4a318f7abe3a16821bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90a4367254cc4a318f7abe3a16821bf8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 90a4367254cc4a318f7abe3a16821bf8 Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-DeleteServersTestJSON-1183106400 Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: f270593db29b4835952de74f591011c5 Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-DeleteServersTestJSON-1183106400-project Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.256461 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '8ee88aad-cfc0-4271-a6b1-95aeb473bf0d'} Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:22.257093 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. Aug 07 01:18:22.258205 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:22.260061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] Returning 404 to user: Instance 8ee88aad-cfc0-4271-a6b1-95aeb473bf0d could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:22.260224 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-73e9d382-5b18-4960-b25c-f94188e7721c tempest-DeleteServersTestJSON-1183106400 tempest-DeleteServersTestJSON-1183106400-project] 10.222.0.36 "GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d" status: 404 len: 111 microversion: 2.1 time: 0.041500 Aug 07 01:18:22.260789 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:22 2022] GET /compute/v2.1/servers/8ee88aad-cfc0-4271-a6b1-95aeb473bf0d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:22.400739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:22.401375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:22.408082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.408555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.408987 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.409670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.410140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.410556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.414801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:22.591056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:22.601572 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-01291144-e7a4-4578-89f5-fcea198b8184 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.204566 Aug 07 01:18:22.618713 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 120/240] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:22 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:23.624765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:23.625411 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:23.631571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:23.632057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:23.632492 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:23.633189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:23.633640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:23.634089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:23.865985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:23.878737 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f2af1fb1-ce3f-45ed-94e8-3589cbf53d46 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1314 microversion: 2.1 time: 0.257424 Aug 07 01:18:23.879017 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 121/241] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:23 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:24.900410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:24.901096 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:24.909017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:24.909536 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:24.909999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:24.910706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:24.911154 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:24.911608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.134525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:25.143347 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fd7061f5-8d60-40e8-bc38-82248c087c10 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1498 microversion: 2.1 time: 0.246994 Aug 07 01:18:25.144882 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 121/242] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:24 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.426019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.428549 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.435025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.435809 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.436751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.438327 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.438995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.439628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.472623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:31.814753 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:31.924856 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dd17af28-bb38-4cff-a2b7-36cf3e211889 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 204 len: 0 microversion: 2.1 time: 0.501973 Aug 07 01:18:31.926065 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 122/243] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:31 2022] DELETE /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:31.935971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.936589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.954681 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.955415 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.962547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.963312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.963789 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.964613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.177816 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:32.185634 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c2f67b79-3184-4d04-bee7-4f4d4fb7a8f2 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1504 microversion: 2.1 time: 0.255093 Aug 07 01:18:32.186231 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 122/244] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:31 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:33.213313 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.214876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:33.229351 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.230630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.231226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.232664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.233283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.233986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.497559 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.506284 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9180bd11-3e43-4a4f-a7fa-a52f5a09d316 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1504 microversion: 2.1 time: 0.301806 Aug 07 01:18:33.506975 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 123/245] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:34.530784 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:34.531718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:34.557410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.559561 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.563099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.564307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.570255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.571722 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.887014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:34.901507 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e4054f2b-7b56-425c-92f8-2c6c646c8e4d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1504 microversion: 2.1 time: 0.372080 Aug 07 01:18:34.901507 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 123/246] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:35.213803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64737288-e1eb-42db-9dad-e4f348012034", "name": "network-vif-deleted", "tag": "3a98b7c2-7dec-476f-b6f9-736ae17cf447"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:35.252802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.252802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.252802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.273364 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] Creating event network-vif-deleted:3a98b7c2-7dec-476f-b6f9-736ae17cf447 for instance 64737288-e1eb-42db-9dad-e4f348012034 on hv-cinder-maste Aug 07 01:18:35.283014 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-b2f38219-9bff-4d74-96eb-932ae4a2177a req-ccee5a3e-7e2e-46ce-8a23-9d472d954437 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073321 Aug 07 01:18:35.292335 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 124/247] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:35.923180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:35.923837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:35.936153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.946044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.946494 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.947239 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.947694 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.948118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.027637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.028691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.029292 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.029932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lazy-loading 'fault' on Instance uuid 64737288-e1eb-42db-9dad-e4f348012034 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:36.122264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181870dc52884c3da93545754cded2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d307b5c73647b99396f19bc7ef676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:36.134782 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dac5b9fe-53b5-448f-84e5-cf3d2c32ec12 tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 200 len: 1304 microversion: 2.1 time: 0.216319 Aug 07 01:18:36.136577 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 124/248] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:35 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:37.157574 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.158312 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] [instance: 64737288-e1eb-42db-9dad-e4f348012034] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.165197 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.165972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.171199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.171199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.171199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.171199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.184934 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] HTTP exception thrown: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Request method failure captured: Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 HTTP/1.1 Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xLHOlBW-MF2vX0du5URo6BxiRjEOaA3lRW-NC9PTS5_2iJ-w96rtAHiuiheUicSFZzociqUqhcinozJn7OwynFZmq7krDZqe3IMqB01HP1vwTst5tux3h0g_Z1Gh5cezRfxo0nOzfz7RwlXQK82BL297ePwyONkI4CYkB_-_JP05LI Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 95d307b5c73647b99396f19bc7ef676b Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-VolumesActionsTest-668844069 Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:18:37.187534 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95d307b5c73647b99396f19bc7ef676b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95d307b5c73647b99396f19bc7ef676b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95d307b5c73647b99396f19bc7ef676b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95d307b5c73647b99396f19bc7ef676b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-VolumesActionsTest-668844069 Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 95d307b5c73647b99396f19bc7ef676b Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-VolumesActionsTest-668844069 Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-VolumesActionsTest-668844069-project Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 181870dc52884c3da93545754cded2b6 Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-VolumesActionsTest-668844069-project Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. Aug 07 01:18:37.189162 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '64737288-e1eb-42db-9dad-e4f348012034'} Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:37.189917 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. Aug 07 01:18:37.191084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.193139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] Returning 404 to user: Instance 64737288-e1eb-42db-9dad-e4f348012034 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:37.194195 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-47be4ad3-c6e5-43cc-b9b2-75baf0791d7d tempest-VolumesActionsTest-668844069 tempest-VolumesActionsTest-668844069-project] 10.222.0.36 "GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034" status: 404 len: 111 microversion: 2.1 time: 0.041989 Aug 07 01:18:37.194946 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 125/249] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:37 2022] GET /compute/v2.1/servers/64737288-e1eb-42db-9dad-e4f348012034 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:40.512936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-728843195", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:40.536238 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:40.634721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] validate_networks() for [('64fc81ca-9ca8-4143-8113-346f57e8b724', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:41.713181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:41.714373 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:41.715261 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:41.715681 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:41.716636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:41.745067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.746331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.746715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.751940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.760831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.761394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.823943 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:41.830021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for user 75266a74abbb4129bac206a7d5944466 and project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:41.864664 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:41.867299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:42.152973 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e99c0f85-4597-43ee-bde5-a7441654d975 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.063309 Aug 07 01:18:42.155885 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 125/250] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:42.167712 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fba30ee8-2796-4ae0-bee9-3b5392c06cb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:42.168328 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fba30ee8-2796-4ae0-bee9-3b5392c06cb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:42.258930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fba30ee8-2796-4ae0-bee9-3b5392c06cb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:42.268484 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fba30ee8-2796-4ae0-bee9-3b5392c06cb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1221 microversion: 2.1 time: 0.105230 Aug 07 01:18:42.269508 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 126/251] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:42 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:42.469111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1052927151", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:42.583934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] validate_networks() for [('64fc81ca-9ca8-4143-8113-346f57e8b724', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:43.473542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:43.474125 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:43.474587 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:43.475126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:43.475660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:43.517228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:43.520935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:43.526056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:43.527104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:43.528840 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:43.530802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:43.582385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:43.594323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for user 75266a74abbb4129bac206a7d5944466 and project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:43.612673 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:43.614859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:43.837441 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-387ca3d6-3c24-4b76-b41f-94d20ef646fd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.381700 Aug 07 01:18:43.838143 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 126/252] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:43.858972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f56d638c-b363-4b26-a6dd-ea62157f691c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:43.860331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f56d638c-b363-4b26-a6dd-ea62157f691c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:43.968880 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f56d638c-b363-4b26-a6dd-ea62157f691c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:43.996837 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f56d638c-b363-4b26-a6dd-ea62157f691c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1222 microversion: 2.1 time: 0.148700 Aug 07 01:18:43.997456 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 127/253] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:43 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:45.021963 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f60c2bbf-313d-4367-bc2b-b40d74e9ef42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:45.022589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f60c2bbf-313d-4367-bc2b-b40d74e9ef42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:45.160743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f60c2bbf-313d-4367-bc2b-b40d74e9ef42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:45.169053 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f60c2bbf-313d-4367-bc2b-b40d74e9ef42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1222 microversion: 2.1 time: 0.151397 Aug 07 01:18:45.170272 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 127/254] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:45 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:45.448506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-01ebcdb2-37c3-479f-9696-8aa7735e5e01 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Action: 'create', calling method: .version_select at 0x7fb7d07cce50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1100820251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpHJfIjUqbjQRvqQPtocl7S5g30yQ7jMWkKHa42ePmhfnHop6YOavl2MX8RqJnL45MuEv+cu57q8ZpVdsA1/RGataMNkTL9FljgR9C83/vAarvzRB7a9DFbCu4EIjRpgQ=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:45.471580 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-01ebcdb2-37c3-479f-9696-8aa7735e5e01 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Getting quotas for project 4de628a664a84c279bfdaa7105972fd4. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:45.476738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-01ebcdb2-37c3-479f-9696-8aa7735e5e01 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Getting quotas for user cb1bbc1683f24a5aa356438e533e1fb1 and project 4de628a664a84c279bfdaa7105972fd4. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:45.631137 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-01ebcdb2-37c3-479f-9696-8aa7735e5e01 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.429058 Aug 07 01:18:45.631763 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 128/255] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:18:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:46.198520 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:46.202545 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:46.232937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.234143 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.236428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:46.247691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.248348 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.252577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:46.625804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:46.643196 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b60691cd-113e-45b5-bd0b-f811ecb22f43 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1218 microversion: 2.1 time: 0.450889 Aug 07 01:18:46.644475 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 128/256] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:46 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1218 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:47.661590 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:47.666762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:47.667376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:47.675572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:47.676067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:47.676504 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:47.682414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:47.683297 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:47.683757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:47.830507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:47.841897 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bea76bb7-0f1d-4c79-acf1-8221cfdce0ea tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1282 microversion: 2.1 time: 0.180826 Aug 07 01:18:47.861055 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 129/257] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:47 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:48.868322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:48.868947 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:48.876008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.876498 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.876935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.878457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.879124 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.879707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:49.176608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:49.190919 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99f03c42-0ff6-4ca8-a166-0602c81a8642 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1280 microversion: 2.1 time: 0.326887 Aug 07 01:18:49.191676 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 129/258] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:48 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:50.212405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:50.213587 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:50.221393 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.222123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.222709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:50.223568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.224197 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.224776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:50.454651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:50.478362 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-35b936c7-2fe5-4a43-90a2-9d52dbfedbf9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.255538 Aug 07 01:18:50.479098 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 130/259] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:50 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:51.492023 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:51.492023 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:51.499335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.499823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.500253 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.500957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.501404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.501818 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.694810 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f301d819-7d3d-4602-9592-2cf2cb0ddfdb", "tag": "d3e13a5d-edf8-4a17-b0c0-636a246478f1"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:51.706452 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.707224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.707834 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.721691 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] Creating event network-changed:d3e13a5d-edf8-4a17-b0c0-636a246478f1 for instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb on hv-cinder-maste Aug 07 01:18:51.726780 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-727cb7e1-6065-44b5-b2fe-d5ed5e0e4cc1 req-bab781f7-e10c-4b61-a714-ffd15fe9e251 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036382 Aug 07 01:18:51.727677 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 131/260] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:18:52.052024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:52.059701 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cab14029-131b-4c73-b9e2-7a7c24eca194 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.575463 Aug 07 01:18:52.060296 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 130/261] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:51 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:53.085056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:53.086828 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:53.093746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:53.094594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:53.096844 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:53.097899 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:53.098650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:53.099290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:53.460606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:53.471876 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-51bde586-a248-4210-8022-f21288265611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.393611 Aug 07 01:18:53.489884 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:53 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:53.768303 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1cd953-ea67-4ef2-a5e6-1b97263901e4", "tag": "b8fbd05f-9663-4ed9-a8e3-996a54d6c644"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:53.786705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:53.791839 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:53.792335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:53.793083 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:53.821736 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] Creating event network-changed:b8fbd05f-9663-4ed9-a8e3-996a54d6c644 for instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 on hv-cinder-maste Aug 07 01:18:53.834598 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-a52716f9-3de7-486a-b233-9cb1a5bbf601 req-af18535e-354e-4eb8-85c5-c7ca4e455ae1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065084 Aug 07 01:18:53.834598 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 131/263] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:54.501325 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:54.502002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:54.508619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:54.509112 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:54.509655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:54.510664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:54.511129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:54.511551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:54.666090 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:54.679919 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1eb42287-85cd-4fc4-90bc-b62769824881 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.182959 Aug 07 01:18:54.680505 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 133/264] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:54 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:55.700036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=14 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:55.706914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:55.707856 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:55.715198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.715604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.716014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.717490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.718229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.718837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.890058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:55.898557 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aed3504a-03a7-448d-a7b4-3102fad1e90a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.200987 Aug 07 01:18:55.913204 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 132/265] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:55 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:56.923396 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:56.924050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:56.926069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=8 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:56.939942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.940734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.941354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:56.942125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.942830 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.943478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.104446 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:57.113254 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e40ea163-c9ec-4c07-ab35-8193b451e008 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.194494 Aug 07 01:18:57.114624 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 134/266] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:56 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:58.135808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:58.136537 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:58.146447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.147004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.147504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.148259 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.148735 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.149159 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.424853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:58.433160 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-baaef357-ece8-4731-b6e9-8923eb774d93 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.302024 Aug 07 01:18:58.434159 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 133/267] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:58 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.455643 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.456547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.463508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.464184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.464800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.465906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.466628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.467366 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.625794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.634500 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0dedbd2f-7876-4ffd-bcb6-abed6661c8ee tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.183174 Aug 07 01:18:59.635514 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 135/268] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:00.655813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.657359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:00.665256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.666012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.666744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.667804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.668434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.669012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.879284 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:00.889050 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ed53051a-9d7f-4812-be71-e2c2ee72b3be tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.237184 Aug 07 01:19:01.046175 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 134/269] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:00 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:01.452448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f301d819-7d3d-4602-9592-2cf2cb0ddfdb", "name": "network-vif-plugged", "status": "completed", "tag": "d3e13a5d-edf8-4a17-b0c0-636a246478f1"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:01.461931 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.462406 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.462836 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.479230 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] Creating event network-vif-plugged:d3e13a5d-edf8-4a17-b0c0-636a246478f1 for instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb on hv-cinder-maste Aug 07 01:19:01.485513 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-9dd90388-1307-4862-bbe5-90896a590ca1 req-0c250257-69b6-4d50-bc85-30a77f35220d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037439 Aug 07 01:19:01.489905 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 136/270] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:01.916604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:01.917324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:01.924932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.925717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.926371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.927262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.927875 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.928461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:02.085086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:02.096902 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5bb75b1a-ef83-4482-8aec-5473958aabff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.183438 Aug 07 01:19:02.109970 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 135/271] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:01 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:03.120863 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.121785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:03.130242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.131114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.131575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.132534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.132929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.133357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.364765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:03.375360 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-419c4121-1bbf-4d53-941f-f9b35b0fda42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.259056 Aug 07 01:19:03.376459 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 137/272] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:04.397613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.399082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:04.407175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.416207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.416207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.416207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.416207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.417043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.669049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:04.669049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=83 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:04.677541 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3c136922-fb0a-4262-95d1-0e4ba14f2fd7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.284639 Aug 07 01:19:04.689874 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 136/273] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.701191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.701885 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:05.708313 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:05.710162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.710812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.712113 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.713199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.714279 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.714871 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.776692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1cd953-ea67-4ef2-a5e6-1b97263901e4", "name": "network-vif-plugged", "status": "completed", "tag": "b8fbd05f-9663-4ed9-a8e3-996a54d6c644"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:05.790162 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.790575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.791005 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.945766 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:05.955400 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-baaf2b15-456e-465d-b710-0c023610ddc2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.258875 Aug 07 01:19:05.962568 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 138/274] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:06.034787 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] Creating event network-vif-plugged:b8fbd05f-9663-4ed9-a8e3-996a54d6c644 for instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 on hv-cinder-maste Aug 07 01:19:06.039968 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-abeff7db-d6b8-41a4-b551-74730ab3505b req-737e2b9c-dab9-4e80-b31d-248ecd3160a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267208 Aug 07 01:19:06.041000 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 137/275] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:06.984344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.985278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:06.991777 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:07.001792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:07.001792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:07.001792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:07.001792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:07.002430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:07.166732 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:07.178597 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a38819cc-29b6-488e-9477-2675518a0cc6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.200018 Aug 07 01:19:07.183319 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 139/276] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:08.223656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.225407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:08.237303 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.238560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.239231 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.240222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.240950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.241579 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.412187 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:08.421598 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eee2735b-ae40-4af8-8892-f3120f569dc5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1322 microversion: 2.1 time: 0.212114 Aug 07 01:19:08.441212 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 138/277] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:08 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:09.456098 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:09.458640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:09.470452 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.471102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.471613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.474517 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.475481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.476277 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.709221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:09.727641 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9dbbca96-ff3f-4e0a-90fe-11b0aa7c1f3e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1516 microversion: 2.1 time: 0.282784 Aug 07 01:19:09.729156 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 140/278] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:09 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:09.756508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:09.760419 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:09.777587 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.779649 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.783025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.783219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.783633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.788844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.839678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'flavor' on Instance uuid 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:19:10.397541 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9a4171a4-8e4e-48db-a3c5-8bd7c550f0e2 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4/action" status: 200 len: 32 microversion: 2.1 time: 0.645697 Aug 07 01:19:10.398476 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 139/279] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:19:09 2022] POST /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4/action => generated 32 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:19:10.408783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:10.419925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:10.419925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.419925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.419925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.420467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.420467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.420467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.640657 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:10.652516 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6ca544d7-6abc-4b58-852e-02e5f524f206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.247552 Aug 07 01:19:10.654562 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 141/280] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:10 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:11.678077 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:11.679422 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:11.687080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:11.695894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:11.695894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:11.695894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:11.695894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:11.696293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:11.872163 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:11.872163 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c3e79628-8010-46cd-aca1-1bd576661022 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.196196 Aug 07 01:19:11.878022 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 140/281] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:11 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:12.894746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:12.894746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:12.899414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.899883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.900485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.901342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.902089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.902511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:13.109745 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:13.122193 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e5d2fa6a-46fc-48ee-a6e1-cb18ae641697 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.233896 Aug 07 01:19:13.135479 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 142/282] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:12 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:14.144674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:14.145314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:14.151836 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.187302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.187302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.187302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.187302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.187711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.298504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:14.305963 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9bfa0ca0-d00b-4c2d-9249-c57efbfbdfb4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.166306 Aug 07 01:19:14.306523 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 141/283] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:14 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:15.327058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:15.328300 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:15.342200 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.343258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.347309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.350203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.350203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.350203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.558049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:15.564048 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7ce6c1ac-c6a7-4da5-8d68-cd2a9a953df0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.241593 Aug 07 01:19:15.572213 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 143/284] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:15 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:16.586081 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:16.586967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:16.598068 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:16.599551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.600037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.600472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.601177 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.601627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.603165 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.876669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:16.887901 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0327852b-2ecc-4228-ab21-aa6439cd102e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.305087 Aug 07 01:19:16.888778 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 142/285] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:16 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:17.910350 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:17.919180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:17.919180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.919180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.919180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.919600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.919600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.919600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:18.083456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:18.096245 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c4b879e1-eb70-47bf-adc4-f9ac020d6628 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.190199 Aug 07 01:19:18.097085 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 144/286] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:17 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:19.117730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:19.118391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:19.126389 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.126874 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.127503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.128203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.128651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.129067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.268600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:19.277997 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eff7a624-c912-498c-9a83-bac834e0defe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.163973 Aug 07 01:19:19.278581 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 143/287] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:19 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:19.951783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8e865c33-0f26-456a-9d1b-d94990f43a43 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'create', calling method: .version_select at 0x7fb7d07ccd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-700662783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCabw7P4bFwTezqVxZdo2iSQ2HtQe7idMqI1HJk9lin1df8PjgzWVUcGCPMEI6lZB4sW+opSYSCTnG69HFZIKl+Rj0jNZ8Q27JvePcvMmlzHTgeMcFQ5Xgs+c/iBawD3cA=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:19.973305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-8e865c33-0f26-456a-9d1b-d94990f43a43 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Getting quotas for project da141dca2d874d4bbb679cde1a089b7a. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:19.977915 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-8e865c33-0f26-456a-9d1b-d94990f43a43 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Getting quotas for user b278dc86c8bb4ee5abd24074c8450189 and project da141dca2d874d4bbb679cde1a089b7a. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:20.107892 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8e865c33-0f26-456a-9d1b-d94990f43a43 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.165864 Aug 07 01:19:20.108500 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 145/288] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:19:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:20.206781 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-234456264", "imageRef": "ac6b1b66-3127-46ac-959c-958ffc4b68a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-700662783", "networks": [{"uuid": "bd360e4d-e69b-4dce-89bb-3c46fb0038a8"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:20.258767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] validate_networks() for [('bd360e4d-e69b-4dce-89bb-3c46fb0038a8', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:20.299848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:20.300458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:20.307514 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.308101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.309129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.309936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.310316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.310741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.456499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:20.466294 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7c118fd2-2e55-40e8-9a4c-10e1e7fb2896 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.170142 Aug 07 01:19:20.467174 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 146/289] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:20 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:20.886100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:20.887193 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:20.887848 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:20.888252 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:20.888657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:20.897242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.897715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.898182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.898895 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.899341 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.899760 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.916325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Getting quotas for project da141dca2d874d4bbb679cde1a089b7a. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:20.920449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Getting quotas for user b278dc86c8bb4ee5abd24074c8450189 and project da141dca2d874d4bbb679cde1a089b7a. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:20.931178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:20.933316 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac6b1b66-3127-46ac-959c-958ffc4b68a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:21.147559 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5ee3dbde-bb2a-4323-9c2b-85ebe394beda tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944686 Aug 07 01:19:21.148201 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 144/290] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:21.158523 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f3475ece-c251-4191-817a-15716a3b0fd8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:21.159150 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f3475ece-c251-4191-817a-15716a3b0fd8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.214893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f3475ece-c251-4191-817a-15716a3b0fd8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.224199 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f3475ece-c251-4191-817a-15716a3b0fd8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1257 microversion: 2.1 time: 0.066857 Aug 07 01:19:21.224199 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 147/291] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:21 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:21.487924 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:21.488534 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.495201 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.495688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.496172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.496870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.497321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.497785 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.629329 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.637656 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-82a34330-2e38-4759-bb3a-b6f5c9ac1d6f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.154117 Aug 07 01:19:21.638265 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 145/292] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:21 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:21.677804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1847148495", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "8e1beac0-d6cc-4ec0-8f3e-f35a14ca8630"}]}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:21.743862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] validate_networks() for [('8e1beac0-d6cc-4ec0-8f3e-f35a14ca8630', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:22.242692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-396145ce-a6ad-4c7f-a346-e6755a3d4950 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.243302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-396145ce-a6ad-4c7f-a346-e6755a3d4950 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.299880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-396145ce-a6ad-4c7f-a346-e6755a3d4950 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.305932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:22.306696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:22.307472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:22.307599 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-396145ce-a6ad-4c7f-a346-e6755a3d4950 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1257 microversion: 2.1 time: 0.068766 Aug 07 01:19:22.308263 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:22.308926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:22.309619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:22.318846 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.319476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.319907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.320621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.321066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.321486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.338412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Getting quotas for project da03f1b485f44bd682faa9ef77a3557c. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:22.342385 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Getting quotas for user cefeb892ad9e4f219d3b7129efe4a994 and project da03f1b485f44bd682faa9ef77a3557c. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:22.353488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:22.356002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:22.658800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.659401 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.665360 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-997adcde-2467-4412-a2b9-2597a77c6bd3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991462 Aug 07 01:19:22.665910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.666363 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 148/294] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:19:22.668447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.669182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.669930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.670418 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.670836 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.677658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e7b1f1ea-5805-487d-a7a3-de64c9ef7ea6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.682541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e7b1f1ea-5805-487d-a7a3-de64c9ef7ea6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.733857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e7b1f1ea-5805-487d-a7a3-de64c9ef7ea6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.741646 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e7b1f1ea-5805-487d-a7a3-de64c9ef7ea6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1214 microversion: 2.1 time: 0.068187 Aug 07 01:19:22.743278 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 149/295] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:22.825721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.833519 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8fb516cf-d49a-4e24-9318-405ddff7c453 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.178650 Aug 07 01:19:22.834115 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 147/296] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:23.329216 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.329783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.335645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.336125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.336555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.337287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.337741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.338241 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.341845 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=97 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:23.398182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.406168 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fbd0d2d4-eff0-4b37-bb5d-6b6d552fbe35 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1261 microversion: 2.1 time: 0.081046 Aug 07 01:19:23.406927 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 150/297] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:23.764242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-67ae67b2-2a30-477a-b95e-3f41acef9e30 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.764867 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-67ae67b2-2a30-477a-b95e-3f41acef9e30 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.816823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67ae67b2-2a30-477a-b95e-3f41acef9e30 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.823707 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-67ae67b2-2a30-477a-b95e-3f41acef9e30 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1214 microversion: 2.1 time: 0.064082 Aug 07 01:19:23.825169 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 148/298] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:23.854430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.855034 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.860948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.861448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.861902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.862588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.863035 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.863466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.000825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.008018 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-81e205ed-7609-4d5a-980a-d323c2c4879d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.157425 Aug 07 01:19:24.008592 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 151/299] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:24.426432 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.426952 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.434624 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.435115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.435548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.436237 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.436683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.437097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.501200 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.508601 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-960e133d-273d-4a1a-a1e1-06abc1f2b775 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1309 microversion: 2.1 time: 0.086293 Aug 07 01:19:24.509166 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 149/300] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:24 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:24.846434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.847032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.852882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.853354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.853779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.854473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.854921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.855371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.927021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.935075 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-53b5d1d0-3644-4914-852c-2f7b71e00a20 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1218 microversion: 2.1 time: 0.092553 Aug 07 01:19:24.935646 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 152/301] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:24 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:25.029053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.029663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.036085 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.036566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.036996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.037702 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.038175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.038596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.180918 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:25.189107 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-969ff09a-ef54-4aca-9930-fb49d6eea46c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.164536 Aug 07 01:19:25.189679 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 150/302] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:25.531168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.531907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.538412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.538968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.539473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.540258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.540778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.541273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.615299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:25.623220 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a03546bc-dd7c-4905-b685-4743f90236b8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1315 microversion: 2.1 time: 0.096365 Aug 07 01:19:25.623800 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 153/303] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:25.962697 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.962697 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.978554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.978554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.978554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.978554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.978871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.978871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.056740 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:26.065235 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c5eef9f8-5dbf-4685-adb1-2a3142dc1a86 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1266 microversion: 2.1 time: 0.107509 Aug 07 01:19:26.066520 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 151/304] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:26.212803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:26.213577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:26.223109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.225497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.225974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.226710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.227178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.227613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.425075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:26.435106 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e6d28837-7232-47d6-a133-01b897cc4fbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.227006 Aug 07 01:19:26.436289 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 154/305] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:26 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:26.646721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:26.648123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:26.656504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.657011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.667971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.667971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.667971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.667971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.808750 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:26.817263 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0039b0dd-c0e8-4f14-af72-1b73eeb28bd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.175922 Aug 07 01:19:26.818123 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 152/306] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:26 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:27.086531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.087139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:27.093744 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.094272 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.094710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.095415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.095868 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.096290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.161188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.170133 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e78e39d1-98b8-4dc9-90a4-d2472297a0cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.087333 Aug 07 01:19:27.171246 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 155/307] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:27.460101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.460704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:27.467393 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.467868 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.468304 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.469160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.469612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.470060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.610255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.621657 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1a78e9d2-e470-4e4b-82e7-281abd40bfe7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.165201 Aug 07 01:19:27.622918 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 153/308] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:27.841020 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.841630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:27.847489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.847964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.855551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.855551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.855551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.855551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.003043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.012526 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f91a84f0-21fd-4bbc-bf24-6d32ead5943d tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.175847 Aug 07 01:19:28.013667 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 156/309] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:28.191989 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.192513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:28.198416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.199571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.199981 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.200660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.201101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.201529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.263834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.266045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:28.271862 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ea4915b5-be47-42ea-abd7-8a5d46de7a35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.083822 Aug 07 01:19:28.272427 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 154/310] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:28 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:28.643016 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.643609 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:28.649513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.650021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.650454 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.651173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.651618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.652223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.786751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.796578 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d4439a00-2055-4669-8b06-ebbe3d869d71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.157384 Aug 07 01:19:28.798966 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 157/311] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:28 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:29.033671 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:29.034298 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:29.040638 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.041107 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.041532 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.042356 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.043403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.043974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.182693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.193702 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0f90b359-427d-4c11-9653-28973d0e6213 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.160645 Aug 07 01:19:29.194395 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 155/312] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:29 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:29.293301 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:29.293889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:29.299856 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.300333 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.300766 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.301450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.301930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.302353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.367863 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.375749 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f1ec6591-bed4-4398-9568-9e3ed5401bf6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.087218 Aug 07 01:19:29.376580 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 158/313] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:29 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:29.818184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:29.819043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:29.828324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.829482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.830282 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.831407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.831986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.832405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.984517 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.992835 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-814832f8-5841-4f9c-97e1-c2352a331a22 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.179288 Aug 07 01:19:29.993414 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:29 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:30.212119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:30.212990 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:30.223400 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.223981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.224576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.225479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.226027 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.226560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.384296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:30.395804 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-be77e76c-26ef-4ffe-8d71-b16cc660b362 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.187801 Aug 07 01:19:30.396553 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 159/315] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:30.397576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:30.398274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:30.405635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.406175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.406604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.407305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.407814 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.408181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.475633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:30.485007 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6b212ea3-d517-48dc-b6ad-e01bdf3aea77 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.091894 Aug 07 01:19:30.491024 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 157/316] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:31.015259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.015870 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:31.022140 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.023282 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.024263 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.025248 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.028159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.028681 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.170567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.178246 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9f620e97-f6bf-4a1d-afa4-43cc8b4a872e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.167550 Aug 07 01:19:31.178877 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 160/317] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:31 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:31.416887 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.417560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:31.420004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:31.428885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.429617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.430290 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.431472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.431920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.432342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.505727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.506294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:31.512556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.513051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.513481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.514275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.514748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.515322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.573548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.581424 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-401f540c-c274-410e-8051-701d89d18226 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.168743 Aug 07 01:19:31.590039 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 158/318] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:31 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:31.590303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.595432 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-55a2fb47-0859-40a8-9fce-c1169c81565a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.093496 Aug 07 01:19:31.596198 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 161/319] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:31 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:32.200374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.200973 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.207649 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.208123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.208551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.209244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.209675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.210119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.348853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.358005 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-715eade5-1f8e-4058-8c2c-cdf1a6fe4afb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.162624 Aug 07 01:19:32.358850 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 159/320] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:32.602115 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.602807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.605183 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:32.610029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.610505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.610935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.611674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.612062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.612479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.618698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.618698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.624608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.625129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.625628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.626390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.626841 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.627267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.708893 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.720268 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6af34dea-f819-4597-8e08-3bdb8448c00e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.107546 Aug 07 01:19:32.730363 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 160/321] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:32.738422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=14 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:32.786088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.794761 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d923cb48-8e03-4ca0-905f-8b981a204cec tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.196460 Aug 07 01:19:32.795895 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 162/322] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:33.380858 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.381562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.397066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.397066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.397066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.397066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.397398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.397398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.534736 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:33.542419 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20236199-793b-4790-9f79-52ffd971811b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.165509 Aug 07 01:19:33.543006 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 161/323] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:33.744714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.746019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.752629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.753129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.753551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.754275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.754728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.755147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.816847 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.817522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.828145 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=10 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:33.831135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.831923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.832413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.833216 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.833893 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.834457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.853637 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:33.862529 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-30a4a3f1-dfa4-4195-9490-9c35953ce1e6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.122760 Aug 07 01:19:33.874423 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 163/324] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:33.984959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:33.993338 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c5da091c-78cb-45a2-b763-270ad2475cce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.180600 Aug 07 01:19:33.998845 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 162/325] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:34.564554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:34.565468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:34.572449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.579246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.579246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.579246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.579246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.579623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.717181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:34.724571 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-84bf5894-29df-4a4b-ae84-5e2b0dffaa06 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.164639 Aug 07 01:19:34.725126 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 164/326] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:34 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:34.886186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:34.886796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:34.893297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.893881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.894322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.895077 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.895530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.895968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.968243 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:34.976257 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d583f7c7-44d0-4663-b145-da1980d66616 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.094220 Aug 07 01:19:34.977939 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:34 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:35.014414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.015018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:35.021008 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.021487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.021942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.022618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.023060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.023474 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.153158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.160594 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7b9818f4-a1a2-4332-bb78-f761226ebc07 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.150307 Aug 07 01:19:35.161173 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 165/328] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:35.745195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.746038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:35.752013 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.752502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.752937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.753630 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.754113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.754558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.890964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.899348 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e1f783c3-c49f-46a2-adfe-aade9fef357c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.158162 Aug 07 01:19:35.899915 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 164/329] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:35.998459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.998996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:36.004848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.005331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.005759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.017071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.017071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.017071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.069063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:36.080088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:36.080088 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-80825e6e-9663-41ac-b7e9-5a796191d944 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.084418 Aug 07 01:19:36.080088 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 166/330] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:36.182330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:36.183524 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:36.189650 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.190404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.191000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.191894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.192504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.193084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.342269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:36.356999 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b3140263-adec-412e-91a1-d36147ac81e0 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.178413 Aug 07 01:19:36.357587 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 165/331] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:36 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:36.922190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:36.923262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:36.930701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.931359 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.931799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.932630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.933216 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.933641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.076259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.083678 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8f6ae590-c960-4afc-9513-85934d8f7e36 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.166332 Aug 07 01:19:37.095415 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 167/332] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:36 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:37.101740 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:37.102374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:37.109396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.109875 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.121971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.121971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.121971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.121971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.188557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.196351 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-52795ee1-6abd-416f-8757-2416de9d022b tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.098449 Aug 07 01:19:37.197139 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 166/333] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:37 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:37.378245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:37.378856 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:37.384807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.385269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.385752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.386805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.387262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.395905 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.517190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.524695 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a2f1cfdc-feb9-4062-ae15-299bab33eab7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.150615 Aug 07 01:19:37.525255 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 168/334] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:37 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.106097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.106711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.113028 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.113514 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.113977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.114668 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.115119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.115538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.218370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.219065 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.225272 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.225769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.226238 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.226937 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.227595 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.228023 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.245547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.253328 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b5a7f722-800b-4be3-883a-bccb9f263c97 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.151770 Aug 07 01:19:38.253915 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 167/335] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.290056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.297917 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c31b55b2-4eba-472e-9e40-abbb14cba185 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.084694 Aug 07 01:19:38.298476 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 169/336] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.545374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.546039 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.551890 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.552388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.552802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.553484 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.553957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.554382 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.685447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.692888 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8b1154a7-d683-4874-b105-d4e06ec65388 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.151443 Aug 07 01:19:38.693442 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 168/337] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:39.273795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.274576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.280441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.285674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.285674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.285674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.285674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.286096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.318522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.319138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.326211 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.326706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.327140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.327832 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.328285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.328707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.400471 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:39.402807 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-497751ac-2cf8-4fec-bbd8-a11b031983e2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.088018 Aug 07 01:19:39.403391 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:39.420903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:39.428691 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-35475efa-da49-46d2-8a54-ce9f9f3bd1a0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.158745 Aug 07 01:19:39.429364 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:39.715452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.716062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.722069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.722690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.723125 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.723809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.724261 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.724677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.856010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:39.863330 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-52d0078d-82ca-4c21-91a8-1db07ce480c6 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.152430 Aug 07 01:19:39.863892 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 170/340] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:40.424320 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:40.428159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.430686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.431161 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.431587 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.432770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.433201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.433618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.454670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:40.455953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.462274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.462764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.463191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.464397 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.464857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.465308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.481556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:40.496649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:40.504664 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a4ddbd71-ed85-4a72-9b48-54c107d6c0ea tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.084070 Aug 07 01:19:40.505309 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:40 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:40.600824 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:40.609106 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a10c04ee-8e79-4f66-803f-ba00a56d5803 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.158317 Aug 07 01:19:40.609713 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 171/342] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:40 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:40.883318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:40.883843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.889970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.890454 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.890884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.891565 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.892014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.892436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.021753 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:41.029915 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-22abe24b-37d3-44a8-aa51-6030be1f6dc1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.150464 Aug 07 01:19:41.030490 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 172/343] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:40 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:41.527052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:41.527673 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:41.534069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.534529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.534952 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.535733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.536184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.536596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.599364 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:41.608513 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0bf527a6-2af2-40c8-a9b9-ebce5fd1c478 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.085986 Aug 07 01:19:41.624334 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 172/344] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:41 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:41.630246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:41.630933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:41.637631 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.638149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.638588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.639274 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.639725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.640146 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.776850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:41.784444 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2e0ddca4-d5f3-4b66-9f25-4d81154bc05a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.157988 Aug 07 01:19:41.785006 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 173/345] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:41 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:42.052597 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.053236 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:42.060371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.060883 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.061318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.062082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.062509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.062930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.192136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:42.199861 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-abc16022-b570-4e99-bbae-fe8ebcca840a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.151547 Aug 07 01:19:42.200419 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 173/346] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:42 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:42.644174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.644174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:42.647091 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:42.650425 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.650905 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.651368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.652137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.652633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.653058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.715602 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:42.723799 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1de43b52-1052-4dfd-ad73-3d65907a9b0f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.084093 Aug 07 01:19:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 174/347] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:42 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:42.804503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.805152 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:42.811895 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.812595 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.813033 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.813761 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.814246 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.814669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.986026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:42.993757 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c4aa863-b511-4d4b-ba87-173d4fecd346 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.193193 Aug 07 01:19:42.994386 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 174/348] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:42 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:43.220793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:43.224234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:43.227638 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.228213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.228719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.229477 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.230043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.230571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.358819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:43.378937 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bfd3ca57-d02f-4cf6-8943-ca69d85ce550 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.149605 Aug 07 01:19:43.378937 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:43 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:43.744771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:43.745383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:43.752335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.752819 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.753254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.754016 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.754494 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.754959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.818516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:43.826674 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c6590fc4-dc27-4cb7-b43f-bd90c9ce788f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.085904 Aug 07 01:19:43.844690 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 175/350] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:43 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:44.015255 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:44.015864 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:44.022167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.022656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.023087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.023771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.024227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.024650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.154368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.162073 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-cc2d2c7c-25b8-4466-a320-681839e4a7ab tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.151110 Aug 07 01:19:44.162649 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 176/351] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:44 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:44.388211 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:44.388808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:44.394715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.395197 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.395626 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.396343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.396797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.397215 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.528740 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.536163 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b7c65ea3-3d8e-458d-a92b-4437d6c418ac tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.152340 Aug 07 01:19:44.536772 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 176/352] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:44 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:44.865246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:44.865882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:44.872893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.873377 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.873826 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.874599 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.875060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.875484 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.941820 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.949610 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8da8180f-383e-4bf9-a77d-4157d326f09e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.088556 Aug 07 01:19:44.951220 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 177/353] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:44 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:45.184581 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:45.185372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:45.191942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.192423 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.192900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.193518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.193999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.194417 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.326567 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:45.334073 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aae6185b-c60a-40eb-a4e5-c945fc34ba01 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.153568 Aug 07 01:19:45.334632 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 177/354] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:45 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:45.556355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:45.556963 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:45.563471 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.563981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.564434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.565144 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.565639 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.566084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.694943 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:45.703565 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-93b2faee-a18a-416f-bc25-141a8e3ad624 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.151031 Aug 07 01:19:45.704127 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 178/355] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:45 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:45.971365 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:45.971974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:45.978161 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.978642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.979109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.979800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.980351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.981064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.043118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.044270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-177288441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1100820251", "security_groups": [{"name": "tempest-secgroup-smoke-1196422512"}], "networks": [{"uuid": "eb5db6a3-ff95-45da-a3d1-129d2b899c6e"}], "block_device_mapping_v2": [{"uuid": "56a773d4-8d3b-4160-ba5c-1624594fa89e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:46.052227 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-572ca4e1-b45d-4bc5-a4b2-a1d438639534 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.084612 Aug 07 01:19:46.052806 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 178/356] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:45 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:46.166818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] validate_networks() for [('eb5db6a3-ff95-45da-a3d1-129d2b899c6e', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:46.355911 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:46.357690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:46.364460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.365085 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.365588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.366391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.366916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.367420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.527816 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.536733 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c8e9867-3166-49cc-b53b-e3a73e761d79 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.185332 Aug 07 01:19:46.537306 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 179/357] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:46 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:46.573151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:46.573984 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:46.574437 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:46.575456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:46.576167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:46.584942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.585520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.586215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.587010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.587550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.588040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.605498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Getting quotas for project 4de628a664a84c279bfdaa7105972fd4. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:46.618084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Getting quotas for user cb1bbc1683f24a5aa356438e533e1fb1 and project 4de628a664a84c279bfdaa7105972fd4. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:46.724301 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:46.725150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:46.731346 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.731843 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.732361 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.733067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.733515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.733984 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.876160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.886102 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-13333b56-26c4-4697-89b8-2e9b9c1cf1ef tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.165761 Aug 07 01:19:46.886720 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 180/358] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:46 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:47.076398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.077026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.088301 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.088710 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.089331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.090072 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.090625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.091268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.108669 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:47.110892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56a773d4-8d3b-4160-ba5c-1624594fa89e',volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:47.246242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:47.254973 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-992c9df3-7e9d-4f7e-aaf6-f9e208332ec0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1274 microversion: 2.1 time: 0.183610 Aug 07 01:19:47.255553 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 181/359] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:47.567226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.568357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.576085 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:47.578408 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.579057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.579817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.580799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.582091 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.582859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.819283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:47.827255 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a0c39c4e-9248-4832-b5be-b9ef93dac525 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.271631 Aug 07 01:19:47.827836 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 182/360] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:47.908420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.909064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.915222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.920717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.920717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.920717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.920717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.921133 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.926025 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8c913e12-d077-49dc-a4bb-836f4270e404 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.885896 Aug 07 01:19:47.932667 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 179/361] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:19:47.937398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2140cc10-92f7-4325-a148-9f2dd8cc99c7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.938110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2140cc10-92f7-4325-a148-9f2dd8cc99c7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.039169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2140cc10-92f7-4325-a148-9f2dd8cc99c7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:48.047184 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2140cc10-92f7-4325-a148-9f2dd8cc99c7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1088 microversion: 2.1 time: 0.113354 Aug 07 01:19:48.058532 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 180/362] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1088 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:48.058532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:48.063703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.064184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.064615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.077371 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] Creating event network-changed:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:19:48.082991 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-03a3fd5b-e4eb-43f7-bcca-ca2d65d1e8aa req-577c557f-ed76-4ef0-bf80-f5ba966fd826 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Aug 07 01:19:48.083788 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 181/363] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:48.154227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:48.173970 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b0c8250d-d15f-4320-b6ee-8d71a5d0b90a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.258492 Aug 07 01:19:48.173970 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 183/364] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:48.276236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.276924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.283775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.284232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.284658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.285369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.285816 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.286436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.787373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:48.795820 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b8fbcb77-e295-4a8d-914a-51fe127b3c07 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.523755 Aug 07 01:19:48.796431 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 182/365] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:48 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:48.850088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.850704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.863643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.864141 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.864574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.865309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.865734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.866188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.068310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e43b48ed-05ae-472b-bfbf-0109e29e48a3 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:49.069105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e43b48ed-05ae-472b-bfbf-0109e29e48a3 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:49.081748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.089421 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-474dd5b7-ea51-4a7a-acdc-e1da20247bb1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.243972 Aug 07 01:19:49.090411 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 184/366] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:48 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.161414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e43b48ed-05ae-472b-bfbf-0109e29e48a3 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.166723 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e43b48ed-05ae-472b-bfbf-0109e29e48a3 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1088 microversion: 2.1 time: 0.103100 Aug 07 01:19:49.167306 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 183/367] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:49 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1088 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.185157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:49.186024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:49.191879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.192360 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.192842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.193501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.193975 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.194397 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.343278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de883173-3add-4bbe-9497-ff078da567db", "tag": "c9caf170-cee9-43b5-986f-9e4f45dbbbf8"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:49.362158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.363783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.364414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.376409 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] Creating event network-changed:c9caf170-cee9-43b5-986f-9e4f45dbbbf8 for instance de883173-3add-4bbe-9497-ff078da567db on hv-cinder-maste Aug 07 01:19:49.382067 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-52e831a4-6a4b-4a44-a88b-739ce250c3af req-87b07e77-47e0-4853-a86e-9e0b0774ac76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043420 Aug 07 01:19:49.389905 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 184/368] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:19:49.390607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.398774 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0abdafaf-6d5f-4503-b27f-5619bca75474 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.218071 Aug 07 01:19:49.399415 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 185/369] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:49 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.818722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:49.819538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:49.826956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.827388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.827831 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.828527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.829089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.829394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.968440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.977526 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2e24b1fe-8c20-464e-9d38-b611ebc476f5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.163538 Aug 07 01:19:49.978223 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 185/370] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:49 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:50.111260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.111873 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.118453 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.118933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.119477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.120094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.120538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.120951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.188072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.189321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.195424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.196124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.200309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.200309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.200309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.200309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.262556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:50.270553 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-827b3fbe-67e3-4386-8366-b3ee8439b711 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.163579 Aug 07 01:19:50.271131 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 186/371] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:50.280428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:50.285936 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6af56bfe-d7b2-47b2-8fc8-a5d57819bcb0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1138 microversion: 2.1 time: 0.102304 Aug 07 01:19:50.286534 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 186/372] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1138 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:50.419881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.420525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.426442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.426921 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.427353 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.428039 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.428490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.428911 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.558863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:50.566776 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c311f875-1172-476c-b0ac-3b46af314d93 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.151477 Aug 07 01:19:50.567327 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 187/373] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:50.999025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:51.001185 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:51.005472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.005996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.006430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.007110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.007573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.007993 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.023124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:51.144398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:51.146321 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c4cbf374-5bf4-4510-8cfb-f39489c75553 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.151125 Aug 07 01:19:51.146890 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 187/374] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:51.291588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:51.292178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:51.298527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.299007 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.299439 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.300144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.300580 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.301000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.304931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:51.311131 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:51.314019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:51.317747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.318259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.318686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.319455 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.319904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.320319 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.382721 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:51.391118 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d0b84029-dfb3-4e61-8f86-5445ad9702c0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1138 microversion: 2.1 time: 0.084295 Aug 07 01:19:51.391695 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 188/375] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:51 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:51.431894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:51.439879 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dae8bdcc-2686-4da4-8fae-e2a5a1c64e13 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.152243 Aug 07 01:19:51.440438 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 188/376] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:51 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:51.586811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:51.587431 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:51.593466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.601696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.601696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.601696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.601696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.602066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.722754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:51.729953 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-987e7e84-edaf-4766-8e94-b44a9fcbc535 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.146888 Aug 07 01:19:51.730559 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 189/377] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:51 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.168826 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.169464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.175547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.176030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.176459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.177141 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.177591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.178048 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.316021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.323623 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-873dd976-c80d-43bc-bf30-846156730b66 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.159018 Aug 07 01:19:52.324186 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 189/378] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.412676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.413287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.421244 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.421986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.422528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.423240 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.423758 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.424185 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.461749 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.462415 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.469461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.471084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.471084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.471283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.471747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.472206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.489501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.499251 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5150598b-9eb2-49ea-bfeb-d08cfd85f8dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1138 microversion: 2.1 time: 0.090906 Aug 07 01:19:52.500165 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 190/379] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.649600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.667971 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-00088a2b-b37c-426e-8acd-dbd7f9305580 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.210442 Aug 07 01:19:52.668775 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 190/380] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.751952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.752431 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.759472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.760001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.760555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.761276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.761729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.763109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.967225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.987524 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-423d93f7-901e-4499-8dee-2e4b3bda20ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.239744 Aug 07 01:19:52.988496 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 191/381] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:53.345926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:53.347324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:53.358546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.361496 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.362317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.363983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.364649 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.365276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.507720 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:53.515711 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ab8212b0-ad19-4868-94e4-e96b5749f906 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.175197 Aug 07 01:19:53.516278 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 191/382] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:53 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:53.520211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:53.520814 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:53.527033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.527441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.528039 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.528763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.529211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.529628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.591984 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:53.599874 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d78c24a0-9f5f-4575-8a4f-b910adc39dd6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1186 microversion: 2.1 time: 0.083460 Aug 07 01:19:53.600437 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 192/383] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:53 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:53.688960 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:53.689560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:53.695396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.695872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.696297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.696977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.697420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.697856 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.836264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:53.844967 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cfcf7297-4f78-42f7-9cf0-2e1403541890 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.160206 Aug 07 01:19:53.845542 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 192/384] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:53 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.008503 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.009135 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.016401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.016401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.016675 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.017375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.017850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.018284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.147009 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.155481 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-301ca7a0-8716-4c2b-ba83-6b64267c0e4a tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.150838 Aug 07 01:19:54.156140 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 193/385] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.536570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.537182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.543877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.544358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.544790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.545478 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.545965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.546395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.624407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.624407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.633778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.634309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.634772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.635494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.635938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.636362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.709472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.719848 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2b244658-e1d3-4a55-9cdc-993648660dd2 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.187142 Aug 07 01:19:54.721274 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 193/386] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.760952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.769963 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8d953066-a9a2-4240-8c79-982d22e633fd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1186 microversion: 2.1 time: 0.152016 Aug 07 01:19:54.770796 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 194/387] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1186 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.866008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.866544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.873038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.873518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.874056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.874741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.875266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.875602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.010331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.018368 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5c899e73-4b51-4718-b9b7-15f2ef9e7e2d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.156340 Aug 07 01:19:55.019069 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 194/388] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:55.176487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.177015 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.183034 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.183515 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.184052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.184743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.185193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.185617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.319018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.332438 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a71bb006-b9de-4a61-b115-95cf4506a26f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.159813 Aug 07 01:19:55.333146 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 195/389] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:55.741466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.742156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.748844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.749322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.749748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.750651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.751101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.751549 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.792565 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.793678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.803166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.803825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.804432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.805496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.806509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.807084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.874417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.882744 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a2f553a5-4cdb-48c3-b6a9-30919c6bbf9b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1186 microversion: 2.1 time: 0.094816 Aug 07 01:19:55.883405 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 196/390] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:55.894388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.902018 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-defe7f00-bdb6-43f3-beec-07e8e66e1efc tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.164324 Aug 07 01:19:55.902589 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 195/391] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.039252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.039947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.046598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.047202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.047842 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.048652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.049195 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.049719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.182516 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.190581 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-490f2398-9522-4bd9-8595-be8eed93e206 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.155149 Aug 07 01:19:56.191146 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 197/392] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.354513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.355128 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.361718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.362240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.371857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.371857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.371857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.371857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.504644 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.514246 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8c730296-b13d-4b9f-8d38-f2e596d4c246 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.163439 Aug 07 01:19:56.514827 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 196/393] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.548677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "name": "network-vif-plugged", "status": "completed", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:56.558229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.559383 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.559897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.571170 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] Creating event network-vif-plugged:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:19:56.576752 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-9261c4d9-203b-42ad-b852-693750bf6121 req-e02d6a0c-3775-4007-9890-320889efee43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Aug 07 01:19:56.577352 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 198/394] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:56.905132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.905843 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.912233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.912712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.913136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.914034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.914528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.914936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.924007 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.924773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.926919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:56.934824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.935311 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.935884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.936491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.937099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.937522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.998376 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.006783 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2a803585-9e8d-43af-bf8e-8fae76d6bfc1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1186 microversion: 2.1 time: 0.106738 Aug 07 01:19:57.007402 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 197/395] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.117786 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.125377 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b5896d4e-2933-4fde-a93a-3ca00223195f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.206161 Aug 07 01:19:57.125973 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 199/396] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:57.213167 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.213806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.220770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.221288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.221718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.222459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.222904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.223322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.358518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.365796 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a0d67a31-faea-4a68-a505-1cde9975a074 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.156615 Aug 07 01:19:57.366378 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 198/397] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.534839 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.535367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.541156 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.541632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.542101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.542782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.543401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.543834 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.674178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.681938 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c9abdef1-8c0f-4582-80df-4ceccb46c9ba tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.150959 Aug 07 01:19:57.688276 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 200/398] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.794847 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.795657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.802127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.820269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.820269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.820269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.820269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.820873 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.831864 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bd95fc11-06c0-4a2d-bf39-847763f4c710 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/ips" status: 200 len: 152 microversion: 2.20 time: 0.042025 Aug 07 01:19:57.832606 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 199/399] 10.222.0.36 () {60 vars in 1289 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:19:58.029003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.029614 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.035609 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.036084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.036524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.037207 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.037656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.038147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.102852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.111309 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-89a1115c-4195-4a5b-bc03-6b8f1124b879 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1186 microversion: 2.1 time: 0.086556 Aug 07 01:19:58.118789 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 201/400] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:58.153687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.153687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.159831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.160313 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.160940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.161640 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.162113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.162535 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.304562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.314034 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-915b158e-8a1a-4c38-940b-f1dec0396ee6 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.165863 Aug 07 01:19:58.314034 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 200/401] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:58.387031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.387832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.394516 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.395260 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.395933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.407348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.415014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.415768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.641049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.670299 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-abb0b0b4-7834-4b00-8975-53ce90230c8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.286575 Aug 07 01:19:58.676509 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 202/402] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:58.705140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.706118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.720761 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.721391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.721951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.722876 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.731919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.732458 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.939930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.949915 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6e4a5695-e838-415d-90cf-3ce8726708ea tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.248286 Aug 07 01:19:58.964601 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 201/403] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:59.134177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.134798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.142122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.143476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.144086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.144793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.145419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.146070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.166645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=10 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:59.224948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:59.237001 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c59e9a0a-cb39-4714-9678-d42969f3d49b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1194 microversion: 2.1 time: 0.106714 Aug 07 01:19:59.238275 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 203/404] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:59.336588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.338620 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.348934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.348934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.350109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.351135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.351779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.352538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.530597 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:59.538035 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-16f56025-f60e-4e85-b9c7-033a38b35797 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.206983 Aug 07 01:19:59.538811 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 202/405] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:59.696172 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.696703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.703481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.703964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.704398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.705081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.705528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.705986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.902108 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:59.904795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:59.911214 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-94d7c1f1-599c-4d99-a7bb-6684cf01dd11 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1522 microversion: 2.1 time: 0.218949 Aug 07 01:19:59.911839 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 204/406] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:59.971713 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.972610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.979098 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.979680 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.980340 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.981894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.982504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.982939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.112977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.120373 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-24e4573d-4cb7-49bc-8062-8155f8faa408 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.152507 Aug 07 01:20:00.120932 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 203/407] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.258965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.259483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:00.265725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.266239 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.266689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.267357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.267803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.268220 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.331913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.339259 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6624b464-65ac-4807-b1ac-1157ce7eddca tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1204 microversion: 2.1 time: 0.084375 Aug 07 01:20:00.339882 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 205/408] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.561803 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.563521 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:00.571850 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.573289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.574270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.575686 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.576299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.576995 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.786136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.793912 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-66f6f44d-b6c4-4d79-a73b-88494887ddf8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.237871 Aug 07 01:20:00.794408 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 204/409] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.863313 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de883173-3add-4bbe-9497-ff078da567db", "name": "network-vif-plugged", "status": "completed", "tag": "c9caf170-cee9-43b5-986f-9e4f45dbbbf8"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:00.874648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.875198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.875716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.933006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.933676 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:00.940574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.941070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.941501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.942249 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.942698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.943116 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.946127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:01.059011 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] Creating event network-vif-plugged:c9caf170-cee9-43b5-986f-9e4f45dbbbf8 for instance de883173-3add-4bbe-9497-ff078da567db on hv-cinder-maste Aug 07 01:20:01.064334 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-a010836e-f821-4b83-9476-ad4ecc5bb5cb req-84529c61-5d42-4a52-abcb-5fb72fc1b09d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204626 Aug 07 01:20:01.064935 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 206/410] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:01.116889 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.125327 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-591d1241-f8c2-4847-88ed-062603333a67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1502 microversion: 2.1 time: 0.196612 Aug 07 01:20:01.126207 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 205/411] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:01.147096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.149560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.153243 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.154419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.154712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.154910 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.155345 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.156074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.156534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.156959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.163858 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.164273 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.164993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.166510 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.166922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.167352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.321483 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.328152 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e1cf9015-6cae-4849-b420-7972765e53a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1516 microversion: 2.1 time: 0.181397 Aug 07 01:20:01.328748 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 206/412] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:01.383355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.385571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.403059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.403997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.404652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.405897 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.407221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.407819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.408530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.416616 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-19b5835d-153d-465b-a6c2-055d444bcf26 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.275091 Aug 07 01:20:01.417058 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 207/413] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:01.436697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:01.446593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.446593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.446593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.446593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.447199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.447769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.448415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.476066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lazy-loading 'flavor' on Instance uuid 39ad4a4c-7d17-429f-a99a-50572de3a588 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:01.510798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.518864 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2fb69e81-59ea-45c1-849a-ea5067e3c1d5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1204 microversion: 2.1 time: 0.147853 Aug 07 01:20:01.519981 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 207/414] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1204 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:01.815253 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.816002 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.822519 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.822996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.823425 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.824390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.824900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.825320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.014214 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.021698 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3fb7107c-ea58-422e-8cf4-dd94b35499a1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.210384 Aug 07 01:20:02.022288 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 208/415] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:02.437582 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.438282 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.452128 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.452617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.453693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.453905 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.454369 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.454825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.676791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.696008 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1ffff70e-9624-4bb1-aff6-b868b7f50354 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1357 microversion: 2.1 time: 0.259916 Aug 07 01:20:02.696878 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 209/416] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:02.717765 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.719711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.732203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.733068 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.733556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.734303 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.734758 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.735183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.954525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.963141 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b62cce9f-4c18-459d-b64e-371f916deff3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/action" status: 202 len: 0 microversion: 2.20 time: 1.530922 Aug 07 01:20:02.964801 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ee247011-419b-47a5-a025-426edc9d53b0 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1272 microversion: 2.1 time: 0.252449 Aug 07 01:20:02.965510 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 208/417] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Aug 7 01:20:01 2022] POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/action => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:02.966279 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 210/418] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:02.976979 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.977670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.985555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.986135 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.986572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.987276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.987901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.988469 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.060192 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.063244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:03.077951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.079375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.080206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.081455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.082389 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.083185 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.339199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.352293 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ec2754d0-ac79-4b88-9dca-2f1ae6d5064f tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.312604 Aug 07 01:20:03.352871 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 211/419] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:03.410127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.412668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.414222 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.415389 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-854833af-0072-46bc-8a2d-3e6187ce1a69 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.442980 Aug 07 01:20:03.416164 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 209/420] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:03.722989 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.723764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:03.732094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.732651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.733148 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.733959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.734640 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.735240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.992117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.993379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.002285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.002963 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.003568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.005634 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.006878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.007955 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.129915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.138309 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-78219351-578a-421f-87bb-4cbb0132e5ce tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1547 microversion: 2.1 time: 0.420066 Aug 07 01:20:04.138881 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 212/421] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1547 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.158327 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.159091 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.179854 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.180412 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.180913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.181739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.182340 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.182935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.259833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.268432 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-856bd190-122e-4dc8-b80d-5fbe616c5867 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1272 microversion: 2.1 time: 0.280159 Aug 07 01:20:04.269176 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 210/422] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:04.274383 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:04.284128 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.284601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.285096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.296201 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] Creating event network-changed:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:20:04.303585 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-3dce7bf4-78d0-42c1-9b64-aa4b7685338b req-5a75ad70-e23e-4856-ac58-1f9d8bfe3f03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033263 Aug 07 01:20:04.304179 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 211/423] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:04.350109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.359657 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-66a8890a-f178-475f-be34-b9b32002a291 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1547 microversion: 2.1 time: 0.205301 Aug 07 01:20:04.360689 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 213/424] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:04.373797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.374592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.381522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.382057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.382500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.383289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.383409 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.383642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.384369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.388907 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.389683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Searching by: {'deleted': False, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a'} {{(pid=118307) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:20:04.396489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.397208 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.398314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.399048 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.399507 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.399992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.498218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.multi_cell_list [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118307) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:20:04.520468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.531161 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-be384262-b819-4ec2-af91-8c6eef36e3e3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1314 microversion: 2.1 time: 0.162375 Aug 07 01:20:04.532419 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 212/425] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.549975 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.550800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.558007 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.558593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.559544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.560364 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.560903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.562062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.611743 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7fe6fb79-b13b-495c-90c2-b6f9a2098ece tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.232585 Aug 07 01:20:04.613099 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 214/426] 10.222.0.36 () {58 vars in 1125 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:04.627648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.628272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.635851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.636342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.636805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.637555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.646773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.646773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.789915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.798161 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1de140d9-df66-4dcf-8bb0-0d8c26850bd1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1547 microversion: 2.1 time: 0.177516 Aug 07 01:20:04.798730 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 215/427] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.828306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.836487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.838082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.839247 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ec4aded5-05a4-4f80-a51c-334aff971f60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.305466 Aug 07 01:20:04.839805 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 213/428] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:05.289706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.290493 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.309944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.310741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.311476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.312338 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.312946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.313640 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.315694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:05.320419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.323748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:05.328793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.329567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.330894 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.331847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.332511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.333230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.380526 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'flavor' on Instance uuid f301d819-7d3d-4602-9592-2cf2cb0ddfdb {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:05.466169 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.473564 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c8509bad-d7d7-4d2a-a2af-a1c708a51307 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.187637 Aug 07 01:20:05.479662 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:05.555084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.555950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.562942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.570593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.570593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.570593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.570593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.571232 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.705083 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.718986 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3ddbb726-57d3-4865-b2d9-fbd6d492a405 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1498 microversion: 2.1 time: 0.167623 Aug 07 01:20:05.719584 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 217/430] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:05.750458 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8d4f3ae0-ee23-4472-944c-9a56d2ddfabd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/action" status: 200 len: 32 microversion: 2.1 time: 0.442696 Aug 07 01:20:05.751254 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 214/431] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:05 2022] POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:20:05.760850 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.761464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.767806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.768288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.768717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.769462 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.769941 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.770371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.865527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.877303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.877303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.877303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.877303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.878074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.878074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.878074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.917079 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.930255 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-73c0ff10-694a-4c71-8b49-ecf7ee8e8567 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.173123 Aug 07 01:20:05.932728 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 218/432] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:06.081598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.097364 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.099734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.101997 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bad57993-d252-4b4b-9300-14595eed5ecc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.242471 Aug 07 01:20:06.103550 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 215/433] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:06.495941 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:06.496566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:06.503593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.504080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.506409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.506409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.506409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.506409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.688229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.696180 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-79477be3-d548-492f-8940-baee7edd4d68 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.204095 Aug 07 01:20:06.696759 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 219/434] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:06 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:06.959604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:06.960205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:06.966080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.966560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.966990 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.967671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.968122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.968539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.149396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.151117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.172588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.173169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.174892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.196516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.196516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.196516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.196516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.197400 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bc75d35d-654b-4a6b-8278-a82ba82e6bef tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.225384 Aug 07 01:20:07.197400 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 216/435] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:06 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.245592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.248008 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.263929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.264795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.265449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.266466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.266949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.267378 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.297085 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:07.330901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:07.376680 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.385036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.386552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.393658 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7e6abd69-ea00-46dc-85bd-e0893ba2967b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.263458 Aug 07 01:20:07.393658 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 220/436] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:07.659604 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-391b1977-4617-426c-b248-7d88abfc2021 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "DELETE /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 204 len: 0 microversion: 2.1 time: 0.420146 Aug 07 01:20:07.660801 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 217/437] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:07 2022] DELETE /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:07.668878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.669526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.676289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.676828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.677238 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.678144 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.678608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.679031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.696783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:07.717741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.718627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.727251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.728872 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.733397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.734383 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.735124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.735706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.836438 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.844432 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5001f015-737f-4f2d-8c56-3595a26048d0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1504 microversion: 2.1 time: 0.179909 Aug 07 01:20:07.845421 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 221/438] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.922366 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.930275 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-af0eb2b3-3866-4f76-a5c6-81fffb71ec94 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.216789 Aug 07 01:20:07.930849 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 218/439] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.951577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5662a3a8-523d-472d-94c0-3e3530f9db6a"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:07.954546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.960576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.961060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.961486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.962224 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.962662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.963077 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.205034 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.205653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.211676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.212149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.212578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.213253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.213699 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.214147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.341160 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.348630 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1676f9a8-7d1b-474b-8457-6617e0f0556f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.147416 Aug 07 01:20:08.349204 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 219/440] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:08.411625 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.412234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.418633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.419126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.419642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.420342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.420789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.421207 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.552240 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.560529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.562045 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.563187 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-260d8d85-b333-4d8f-b5af-1f5f2a10cbab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.155802 Aug 07 01:20:08.563788 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 220/441] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:08.568109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.568588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.574555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.575037 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.575469 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.576151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.576596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.577013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.600266 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4af13cf2-3fb8-48df-948a-e554746bb725 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/ips" status: 200 len: 147 microversion: 2.1 time: 0.035483 Aug 07 01:20:08.600848 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 221/442] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:08.867506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.868133 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.874035 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.874513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.874947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.875631 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.876083 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.876508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.008462 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.016744 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dfdbff50-b5d7-460c-b44d-ef7efebe1752 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1504 microversion: 2.1 time: 0.154592 Aug 07 01:20:09.017305 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 222/443] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:09.024345 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.026014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.030871 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.031349 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.031783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.032469 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.032919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.033340 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.170725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.178617 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-41db0f07-752d-4289-b904-41b0d5dbf40a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.157929 Aug 07 01:20:09.179290 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 223/444] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:09.370045 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.372472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.388392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.389011 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.389446 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.390260 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.390713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.391022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.524940 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.533222 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3326309d-2c21-4745-9f92-909b1437edf7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.167356 Aug 07 01:20:09.534152 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 224/445] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:09.586727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.587330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.593866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.594343 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.594785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.595460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.595936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.596357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.728486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.737221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.738746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.739900 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2d802227-24ed-4152-b5a0-11c496b0032a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.157153 Aug 07 01:20:09.740440 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 225/446] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:10.038117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.038771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.046439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.049212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.049212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.049212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.049212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.049566 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.194481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.220982 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fee2d705-5d7b-4f5c-9759-77ea27b8916d tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1504 microversion: 2.1 time: 0.187132 Aug 07 01:20:10.221580 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 226/447] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:10.234288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.234288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.242504 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.243000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.243437 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.244164 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.244783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.245211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.393728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.402244 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9404e4b9-8376-4779-a9a9-04e08d828cb7 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.179528 Aug 07 01:20:10.403000 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 227/448] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:10.555012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.555707 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.562778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.563342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.564046 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.564823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.565509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.566034 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.712629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.721242 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-311fb885-815b-404b-a9b4-f61853d8f5e7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.170113 Aug 07 01:20:10.721814 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 228/449] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:10.763144 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.764453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.771167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.771643 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.772073 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.772759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.773204 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.773618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.904624 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.912621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.914229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.915394 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-224b48d4-c0d6-4c93-9a6b-5b1717d4c5ff tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.156800 Aug 07 01:20:10.915949 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 229/450] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:11.242123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.243061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.250571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.251153 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.251946 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.252641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.253291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.253659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.412904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.424623 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f2e214c8-8915-4b4d-a260-3cd3403c61c7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1504 microversion: 2.1 time: 0.186483 Aug 07 01:20:11.425375 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 230/451] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:11.440685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.441451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.449056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.449906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.450354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.451058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.451544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.452058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.671514 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.679879 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-46326ed2-c83e-4658-afc3-4a0ae35265f6 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.253395 Aug 07 01:20:11.680530 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 231/452] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:11.743259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.743875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.750741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.751228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.752086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.752869 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.753394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.753929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.905522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.913524 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0d7a584b-25d3-4860-92c5-21d1b1ee3749 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.174250 Aug 07 01:20:11.914247 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 232/453] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:11.939658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.940360 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.946633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.947208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.947728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.948613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.949060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.950519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.095486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.103408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.104829 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.106549 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-35f5d953-2f27-4e44-af24-aa967495b0e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.170946 Aug 07 01:20:12.107109 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 233/454] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:12.446148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:12.446821 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:12.453561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.454101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.454538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.455228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.455679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.456101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.460352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:12.592427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.593170 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2e8db862-51b7-4708-bb1b-3aac213c2d45 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.645770 Aug 07 01:20:12.604392 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 222/455] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:20:07 2022] POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments => generated 194 bytes in 4658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:12.609903 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fc2372c6-7dc9-452f-abfd-7fca57041b88 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1504 microversion: 2.1 time: 0.167404 Aug 07 01:20:12.619172 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 234/456] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:12 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:12.661859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6876ab43-f180-4af4-83c3-75510488daac"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:12.664779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:12.677482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.678037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.678964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.679518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.680612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.681409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.695752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de883173-3add-4bbe-9497-ff078da567db", "name": "network-vif-deleted", "tag": "c9caf170-cee9-43b5-986f-9e4f45dbbbf8"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:12.706272 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.706752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.707180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.726050 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] Creating event network-vif-deleted:c9caf170-cee9-43b5-986f-9e4f45dbbbf8 for instance de883173-3add-4bbe-9497-ff078da567db on hv-cinder-maste Aug 07 01:20:12.732413 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-e70079f4-a413-4734-bc27-06de6c317410 req-026d2d84-c89e-422d-9971-ffd5698fa6e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045465 Aug 07 01:20:12.733002 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 235/457] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:12.741816 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:12.743165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:12.750593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.751150 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.751655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.752413 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.753345 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.753948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.907088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.914609 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c72209cf-a6d0-4367-bd5b-49b3ec1782ac tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.179114 Aug 07 01:20:12.915181 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 236/458] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:12 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:12.934344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:12.935101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:12.940945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.941430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.941887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.942601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.943055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.943483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.082924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.090562 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7a4e80bb-71b0-4293-8e9a-819c5d446224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.160581 Aug 07 01:20:13.091349 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 237/459] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:12 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:13.128779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.132416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:13.135805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.136316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.136930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.137904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.138375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.138804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.281521 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.290926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.292480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.299538 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0994319c-34eb-4e6b-b185-2db75104f126 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.168849 Aug 07 01:20:13.299538 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 238/460] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:13 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:13.584489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:13.594496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.595003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.595436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.607593 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] Creating event network-vif-plugged:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:20:13.612445 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-d526e9b4-c92f-4826-861e-f049c6292393 req-95ba5603-6855-465d-b2c5-377ee1b3d8a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031846 Aug 07 01:20:13.613029 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 239/461] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:13.639965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.640702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:13.646962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.647445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.647884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.648610 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.649118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.649567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.680368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.680847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.681303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.681748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lazy-loading 'fault' on Instance uuid de883173-3add-4bbe-9497-ff078da567db {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:13.726225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.734323 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-67e74871-e1f6-4712-b536-487c35c93951 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1304 microversion: 2.1 time: 0.098627 Aug 07 01:20:13.734898 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 240/462] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:13 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:13.937152 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.937716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:13.944920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.945493 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.945987 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.946716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.947231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.947822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.085146 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.092963 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f1ebb44f-b4af-44cf-ad01-18ab07a044b4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.160858 Aug 07 01:20:14.093510 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 241/463] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:13 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:14.112234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:14.112865 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:14.118792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.119278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.119715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.120397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.120852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.121307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.243301 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47bac558-8790-418e-bf84-87f4577323b6 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.585881 Aug 07 01:20:14.244011 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 223/464] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:20:12 2022] POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments => generated 194 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:14.252959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.260589 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1b1cfabe-781e-4baf-a8e5-2e77ee931704 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.152218 Aug 07 01:20:14.261150 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 242/465] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:14 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:14.318845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:14.319923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:14.327634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.328427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.329084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.330074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.330622 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.331260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.431994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:14.466224 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.474133 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.475625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.476766 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8f563027-6763-45d2-87a2-24e6cba9a41d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.163362 Aug 07 01:20:14.477322 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 224/466] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:14 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:14.756500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:14.757151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:14.763902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.764376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.764802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.765493 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.765977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.766395 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.796978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.797649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.798103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.798547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lazy-loading 'fault' on Instance uuid de883173-3add-4bbe-9497-ff078da567db {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:14.845952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.853543 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d5b35e1a-0038-4832-8a25-e242af76cab8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 200 len: 1304 microversion: 2.1 time: 0.100902 Aug 07 01:20:14.854182 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 243/467] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:14 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:15.115589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:15.116547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.123518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.124064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.124496 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.125188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.125631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.128040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.263787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.271212 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-34a6c290-9425-481c-96b1-625a030d890f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.159648 Aug 07 01:20:15.271768 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 225/468] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:15 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:15.282616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:15.283304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.289741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.290727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.290727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.291413 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.291857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.292274 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.427113 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.435963 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2388fd6e-ce41-4022-a135-dafe1182be71 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.157204 Aug 07 01:20:15.436544 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 244/469] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:15 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:15.500039 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:15.500771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.507160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.507643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.508075 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.508765 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.515651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.515651 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.647805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.656491 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.658052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.659201 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-273a367f-4037-4f2e-b035-59eeb566352a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.163890 Aug 07 01:20:15.659780 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 226/470] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:15 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:15.875072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:15.878070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: de883173-3add-4bbe-9497-ff078da567db] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.885121 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.885875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.886328 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.887550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.888041 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.888423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.903343 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] HTTP exception thrown: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Request method failure captured: Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db HTTP/1.1 Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xMVrbZunQ3qEIr5NM3ZHozyoE_dDsz_e5g0qeE1ulVy9WkTuKc54x29QtIyYlCH0wtGRVho13bhwp-Ljkbp8ZlNMLyT5IsRDE22cVdvsxoaZSs-ZDM1dI1Pol3R3CBi--TiLnYfXdDC2R_Q375MVEGwqTIy31YzWQ7m1CNpq2eQiXQ Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: da03f1b485f44bd682faa9ef77a3557c Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:20:15.904994 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da03f1b485f44bd682faa9ef77a3557c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: da03f1b485f44bd682faa9ef77a3557c Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-VolumesActionsTest-2144237571-project Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: cefeb892ad9e4f219d3b7129efe4a994 Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-VolumesActionsTest-2144237571-project Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. Aug 07 01:20:15.906490 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'de883173-3add-4bbe-9497-ff078da567db'} Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:15.907231 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. Aug 07 01:20:15.908696 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.910012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Returning 404 to user: Instance de883173-3add-4bbe-9497-ff078da567db could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:15.910012 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fdd47ed8-1d12-4244-933f-ef483c4a0785 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db" status: 404 len: 111 microversion: 2.1 time: 0.035424 Aug 07 01:20:15.910012 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 245/471] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:15 2022] GET /compute/v2.1/servers/de883173-3add-4bbe-9497-ff078da567db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:16.009820 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2012110590", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "8e1beac0-d6cc-4ec0-8f3e-f35a14ca8630"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:16.063404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] validate_networks() for [('8e1beac0-d6cc-4ec0-8f3e-f35a14ca8630', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:16.296336 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.297398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.305656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.306466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.308118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.308118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.309236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.310036 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.452631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:16.453198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.454088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:16.454764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:16.455383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:16.455797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:16.461268 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5a70412b-b30c-405c-81b2-82acbbf46229 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.172089 Aug 07 01:20:16.461824 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 246/472] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.475459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.476066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.478213 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.479058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.479325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.480325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.481472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.481924 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.483172 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.483634 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.484060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.484787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.485242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.485672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.500312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Getting quotas for project da03f1b485f44bd682faa9ef77a3557c. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:16.504755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Getting quotas for user cefeb892ad9e4f219d3b7129efe4a994 and project da03f1b485f44bd682faa9ef77a3557c. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:16.514046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:16.516454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:16.518745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:16.625523 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.634552 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bf233ef1-c948-4ee4-993d-8e1e1a602d8d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.163428 Aug 07 01:20:16.635509 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 247/473] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.682215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.682860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.689448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.689958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.690388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.691064 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.691534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.691950 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.715640 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d752eff2-e90e-4a92-803a-1d841b5484c1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709712 Aug 07 01:20:16.722436 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 227/474] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:16.727914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c0fc480-be0e-4b0f-9c0f-de1707ce2ae8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.728539 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c0fc480-be0e-4b0f-9c0f-de1707ce2ae8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.825634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c0fc480-be0e-4b0f-9c0f-de1707ce2ae8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.834852 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c0fc480-be0e-4b0f-9c0f-de1707ce2ae8 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1214 microversion: 2.1 time: 0.110799 Aug 07 01:20:16.836194 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 228/475] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.853876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.862926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.864668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.865924 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b2e3b815-7eb0-4aa1-85c7-bf2a642099ba tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.187675 Aug 07 01:20:16.866669 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 248/476] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:17.427454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.428150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.435114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.435700 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.441599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.441599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.441599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.441599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.491591 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.500697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.524236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.524787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.528212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.528212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.528212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.528212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.615060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:17.624267 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4e8c2a9c-1d2d-46e5-860a-36a7e6e788f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1593 microversion: 2.1 time: 0.200665 Aug 07 01:20:17.624836 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 229/477] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1593 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:17.656058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.656675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.665635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.665635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.665635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.665635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.666402 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.666402 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.686891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:17.694762 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ac664885-85ae-4d88-8efd-e7241756dcdd tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1260 microversion: 2.1 time: 0.210432 Aug 07 01:20:17.695537 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 249/478] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:17.822808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:17.831431 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eba63d8a-1b64-499d-9139-fbbb5b932c0b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.179355 Aug 07 01:20:17.832111 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 230/479] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:17.855859 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-83e3c3e1-5075-4fbc-b1b9-ed9a1fb3fa15 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.856659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-83e3c3e1-5075-4fbc-b1b9-ed9a1fb3fa15 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.889178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.889716 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.895687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.896177 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.896612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.897303 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.897787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.898235 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.912911 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-83e3c3e1-5075-4fbc-b1b9-ed9a1fb3fa15 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:17.920253 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-83e3c3e1-5075-4fbc-b1b9-ed9a1fb3fa15 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1214 microversion: 2.1 time: 0.068042 Aug 07 01:20:17.921182 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 250/480] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:18.046209 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.057671 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.059933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.061361 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-749db2dd-d9cf-494d-9a37-998e4fbd2706 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.176850 Aug 07 01:20:18.062060 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 231/481] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:18.719111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:18.719722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:18.725766 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.726300 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.726815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.727397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.727843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.728262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.854381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:18.855586 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:18.863385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.866156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.866156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.866156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.866156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.867910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.968525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.979841 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-af57035e-ae3c-4231-bdda-38ca0cd9ee1e tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1444 microversion: 2.1 time: 0.265623 Aug 07 01:20:18.983773 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 251/482] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:18 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1444 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:18.988787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:18.989564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:18.995540 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.997044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.005404 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.010455 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.013887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.014502 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.088798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.106262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.107775 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1d42ceb3-b453-4299-9b99-f665641a66a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.258841 Aug 07 01:20:19.109176 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 232/483] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:18 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:19.116075 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c391a3fe-fe73-4d90-8c92-b7fb33badc56 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1218 microversion: 2.1 time: 0.131071 Aug 07 01:20:19.116995 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 252/484] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:18 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:19.128571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:19.129181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:19.130385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:19.131492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:19.135481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.136000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.136458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.138052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.138519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.138949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.139457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.139952 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.140549 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.141747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.142230 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.142655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.143440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:19.297610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.305097 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e7a57d61-296c-4026-b731-5b549ca94c20 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1444 microversion: 2.1 time: 0.194330 Aug 07 01:20:19.313505 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 233/485] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:19 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:19.351690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.360234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.362180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.363423 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ed8fc419-8423-4244-bec5-e1b817ddf4a6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.245466 Aug 07 01:20:19.364124 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 253/486] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:19 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:19.771037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:19.779145 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.779648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.780299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.844632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Going to try to stop instance {{(pid=118307) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:20:20.096724 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-16220fa1-24ce-4a9b-a580-dece7aa172ba tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action" status: 202 len: 0 microversion: 2.1 time: 0.329285 Aug 07 01:20:20.107444 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.108866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.109195 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 234/487] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:19 2022] POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:20.115910 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.116471 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.116966 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.117866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.118343 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.118769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.131198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.132030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.138965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.139454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.139883 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.140581 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.141029 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.141448 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.277361 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.286339 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-11512bbd-c014-4ff5-b702-e07341c0d056 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.159477 Aug 07 01:20:20.286948 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 235/488] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:20.291927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.292859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.301221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.301718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.302339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.303261 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.303950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.306584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.310070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:20.369872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.378923 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-78f2a70a-2b2b-482e-94b3-941912071053 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1274 microversion: 2.1 time: 0.090725 Aug 07 01:20:20.379507 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 236/489] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:20.389486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.390542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.397707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.403896 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.403896 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.403896 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.403896 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.404240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.480060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.489692 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-547ddf72-4a82-492a-9c73-aaa4172fe88d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.386530 Aug 07 01:20:20.490352 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 254/490] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:20.550816 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.560488 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.562261 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.563572 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b4d51f54-af9c-4422-b222-f2f0d43fd947 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.178812 Aug 07 01:20:20.564203 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 237/491] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:20.898710 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:20.923969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.925089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.926601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.969143 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] Creating event network-changed:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:20:20.984408 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-5ce16ad5-53ae-4ff7-ac82-167dd1c9360d req-8dbaf995-3a2a-4d47-820e-821b6840ead0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086195 Aug 07 01:20:20.990772 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 255/492] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:21.313751 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.315974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.325682 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.328308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.328974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.330992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.331873 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.332512 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.401549 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.403406 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.414037 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.416019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.416998 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.418887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.419795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.420463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.550262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:21.563580 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-771032ce-9961-49ab-aa86-f24a06f3b212 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1272 microversion: 2.1 time: 0.166790 Aug 07 01:20:21.578246 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 256/493] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:21.585201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.586132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.595173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.595903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.596697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.597618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.598344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.598987 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.660752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:21.674060 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ddedf678-dec4-4f05-9daa-4578bfe55832 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.364537 Aug 07 01:20:21.693731 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 238/494] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:21.701843 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.703219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.713732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.719376 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.720097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.721782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.722463 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.723132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.968920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:21.995915 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b6dacfa5-dd6b-4005-83c1-c39cbc4688b5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.413932 Aug 07 01:20:21.996791 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 257/495] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:22.068900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.080713 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.094787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.094787 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d23638be-517d-4a4a-82c4-e3e3132226e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.389808 Aug 07 01:20:22.094787 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 239/496] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:22.588587 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:22.589294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:22.593189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:22.598626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.599230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.599771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.600561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.601234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.601860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.697026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:22.697628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:22.708646 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.710022 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.710676 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.711955 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.712847 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.713611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.937285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.946992 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b3b5533c-7a8c-4ad3-9ef1-0d50db8877a1 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.254313 Aug 07 01:20:22.948489 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 240/497] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:22 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:23.019527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:23.030794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:23.037718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.038321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.039097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.039886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.040469 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.041256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.111572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.119953 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1cf3bd9d-e8ce-4a1c-bfbf-b8c281adb666 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.536509 Aug 07 01:20:23.120897 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 258/498] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:22 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:23.127685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:23.142365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:23.142365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.142365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.142365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.142893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.142893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.142893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.274386 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.283591 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e9ac2fbd-478c-4fed-a36e-681b4b896074 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.270171 Aug 07 01:20:23.284386 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 241/499] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:23 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:23.354951 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.363548 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.365050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.366469 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1074e129-8277-41d5-a6de-2c7237bd7057 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.243812 Aug 07 01:20:23.367200 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 259/500] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:23 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:23.518196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9895dba3-213a-4b25-9da6-51dcc33f9806", "tag": "d751ccb6-f7f1-4072-806a-a1916f498e12"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:23.527465 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:23.540556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.541030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.541473 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.547782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.548257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.548894 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.567206 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] Creating event network-changed:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:20:23.571242 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] Creating event network-changed:d751ccb6-f7f1-4072-806a-a1916f498e12 for instance 9895dba3-213a-4b25-9da6-51dcc33f9806 on hv-cinder-maste Aug 07 01:20:23.577448 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-d2252eb0-b63c-47b8-98ee-50475d29fde2 req-c6a0b135-2291-4fef-b470-7e89481ada6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066537 Aug 07 01:20:23.580155 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 242/501] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:23.580272 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-04cfdf14-41ff-4a83-932a-bbc1d9955d88 req-ad656cc5-c63c-4029-8309-d9c803eb53e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055097 Aug 07 01:20:23.580272 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 260/502] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:23.982110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:23.982946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:23.995229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.995650 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.996099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.997401 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.004022 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.004639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.141369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.142266 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.149952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.150781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.151284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.152058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.152839 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.153429 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.185543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.194665 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0b493f4b-e8ea-4912-b998-8169086d8cd3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.221223 Aug 07 01:20:24.195949 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 243/503] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:23 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:24.316502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.317442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.326045 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.337737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.337737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.337737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.337737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.338375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.338375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.346077 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-219b3bd6-b1ed-4505-9a78-4eae01fa9f75 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.208823 Aug 07 01:20:24.346677 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 261/504] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:24.389627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.390526 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.397136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.398572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.399201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.400231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.400926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.401523 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.510178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.518171 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-df7755c4-d85d-4751-8bd6-c9a4badf1610 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.206554 Aug 07 01:20:24.528130 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 244/505] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:24.566738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.575416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.576976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.578236 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1e53ddca-bfd1-476b-9e1a-c439f335aa94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.192994 Aug 07 01:20:24.579164 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 262/506] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:25.216479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.217083 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.223734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.224221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.224654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.225339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.225790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.226255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.369043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.372347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.380738 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:25.380972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.381644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.382274 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.383327 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.385065 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.385691 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.391803 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3ee420ef-4015-49f2-8177-ca5b644d5848 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.177707 Aug 07 01:20:25.392965 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 245/507] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:25.474567 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "name": "network-vif-plugged", "status": "completed", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:25.490574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.491301 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.491738 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.520619 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] Creating event network-vif-plugged:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:20:25.526947 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-0e6e1c96-2a92-4668-ad59-18856e459b79 req-66d655ed-464c-42fd-b433-acbd5fc8e707 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056067 Aug 07 01:20:25.536455 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 246/508] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:25.536455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-320455565"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:25.536455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.543762 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.544603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.545104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.546070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.547045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.547938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.698187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:25.708089 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-44af4655-0653-4c50-aaf1-83dce2fecc5a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.343240 Aug 07 01:20:25.708809 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 263/509] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:25.714620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.716322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.723700 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.724512 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.724959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.725895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.726388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.726820 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.912449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:25.922919 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4e5a992b-d245-4484-aeff-ebf2d398767e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.212704 Aug 07 01:20:25.923961 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 264/510] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:25.942939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.943683 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.950928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.951424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.951858 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.952797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.953255 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.953681 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.130521 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.network.security_group_api [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Adding security group 6fb2dabc-1e0f-4cc6-bed2-9ab6b187c52b to port 19f6d674-73ae-4569-8dff-d24ceabf6608 Aug 07 01:20:26.140853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.147895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.149397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.150609 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c6ee4228-80c9-410c-aa83-4a3e7595b8d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.212630 Aug 07 01:20:26.151140 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 265/511] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:26.413673 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:26.414658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:26.421281 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.427296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.427296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.427296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.427296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.427669 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.490528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:26.555753 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.563702 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a5227206-a3a1-4b91-b357-3a5715f5f303 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.155066 Aug 07 01:20:26.564339 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 266/512] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:26 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:26.729378 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:26.730026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:26.736139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.736616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.737042 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.737718 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.738186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.738604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.830056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:26.869819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.882454 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5c5a03ca-cebd-46a3-b155-bf05db3fc7d9 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.156489 Aug 07 01:20:26.883093 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 267/513] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:26 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:26.941036 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4f9e9595-ea4d-460d-beda-d9a1d16b43c1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action" status: 202 len: 0 microversion: 2.1 time: 1.408448 Aug 07 01:20:26.942782 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 247/514] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:25 2022] POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:26.948970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:26.949151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:26.949151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:26.949314 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:26.956227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.957089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.958365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.958869 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.959037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.959353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.960080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.960490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.960623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.960953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.961383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.962908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.182080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.191690 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e234a297-bc29-4b0a-af4d-4ff83c52c603 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.247574 Aug 07 01:20:27.192726 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 268/515] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:26 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.197123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:27.207355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.207820 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.208245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.216499 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.220190 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] Creating event network-changed:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:20:27.225276 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-d789b531-0ad1-490e-8c9e-76ff00bcc953 req-d792a9d4-ec3c-429a-99e2-abe961f05048 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Aug 07 01:20:27.226265 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 269/516] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:27.226868 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2dca95b3-41f6-4ab6-acc3-7f5f4b97de05 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1757 microversion: 2.1 time: 0.282716 Aug 07 01:20:27.227565 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 248/517] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:26 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1757 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.231810 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:27.232502 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.239033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.239512 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.239942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.240752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.241080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.241516 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.374169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.382620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.384119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.385277 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7d7e9c9e-6558-43a2-925a-75adddc79d29 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.158153 Aug 07 01:20:27.385843 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 270/518] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:27 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:27.585992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:27.586600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.593385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.594039 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.594476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.595168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.595658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.596084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.743448 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.751071 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9e75b94c-a928-461e-81c4-610351e37ee9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.169146 Aug 07 01:20:27.751758 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 249/519] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:27 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.906568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:27.907801 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.913933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.917018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.917018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.917018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.917018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.917352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.920537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.054973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.057689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.063764 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3544f5e5-1c01-46d5-95fb-53ae3dbd0fc7 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.161859 Aug 07 01:20:28.064338 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 271/520] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:27 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:28.212493 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.213135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.219231 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.219730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.220149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.220837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.221288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.221707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.408506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.409149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.415526 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.416017 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.416615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.417351 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.417800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.418415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.468153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.476783 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-771eedf0-829e-4553-a783-a4c39ee35209 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.268137 Aug 07 01:20:28.478151 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 250/521] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:28.551913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.560528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.562084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.563228 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-17d633bb-6732-45c0-8bcc-a3e38a1dc321 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.158858 Aug 07 01:20:28.563783 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 272/522] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:28.773031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.773663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.780142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.780617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.781047 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.781729 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.782203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.782625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.917269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.932448 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b2f7b723-fae1-4329-b6a5-693381cfd675 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1502 microversion: 2.1 time: 0.163207 Aug 07 01:20:28.944777 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 251/523] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:28.954419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da8353c0-e768-49ee-a29c-418dcd1300ef"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:28.956884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.962876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.963362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.963792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.964482 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.965449 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.965948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.991342 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] HTTP exception thrown: Cannot 'attach_volume' instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb while it is in vm_state rescued Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Request method failure captured: Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/os-volume_attachments HTTP/1.1 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 74 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xLvNd-I3isnSu5qim6ZtzAjVLP5O9slOoH1qEh5k2fvFMuy_FbNh_b0E2ZtIQ6WGkvzEpj-XCdoxYTqVmxQgbAoXCs8ZNgcwxS4HeYneRzvMQ2nmjZ9qy0txnsPOYfYeX6t4673mi6CpUlEH58e_hbD8b0xQ3nTJ_jPkVRgofsRNOA Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:20:28.993215 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32cc230c70b341fca95fa1b962d73909", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 75266a74abbb4129bac206a7d5944466 Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: {"volumeAttachment": {"volumeId": "da8353c0-e768-49ee-a29c-418dcd1300ef"}} Aug 07 01:20:28.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Cannot 'attach_volume' instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb while it is in vm_state rescued Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'server_id': 'f301d819-7d3d-4602-9592-2cf2cb0ddfdb', 'body': {'volumeAttachment': {'volumeId': 'da8353c0-e768-49ee-a29c-418dcd1300ef'}}} Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:28.995326 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb while it is in vm_state rescued Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:28.996454 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb while it is in vm_state rescued Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Returning 409 to user: Cannot 'attach_volume' instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb while it is in vm_state rescued {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8951c4c3-7770-42b0-be37-8fd9a399c6e3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045577 Aug 07 01:20:28.998143 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 273/524] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:20:28 2022] POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:20:29.003971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:29.004514 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.010328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.010808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.011414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.011927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.012379 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.012799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.085191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.085924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.092423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.092901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.093324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.094043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.094503 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.094911 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.229589 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.237765 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-837b9b2d-103b-47e6-b80f-8778de384be4 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.156518 Aug 07 01:20:29.238566 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 274/525] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:29.365684 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0ae83ec6-c12f-4a6c-a370-90eadd6d5e87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.365638 Aug 07 01:20:29.367077 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 252/526] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:28 2022] POST /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:29.374517 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.375124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.381141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.381622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.382080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.382932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.383389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.383812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.500154 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.500854 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.506951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.507436 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.507866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.508593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.509075 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.509470 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.512628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.520369 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e79dce0e-4ba9-4c35-8a66-381fb4dde398 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.149746 Aug 07 01:20:29.521142 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 275/527] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:29.526326 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:29.586401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.587000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.594615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.595127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.595567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.596273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.596720 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.597162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.643789 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.651880 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3597f8d5-7156-4adb-8f34-485b44e63666 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.156077 Aug 07 01:20:29.652511 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 253/528] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:29.730985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.738952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.740509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.741684 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-eb7aba8e-516b-4d5e-9bfd-32deb6bfc3af tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.159218 Aug 07 01:20:29.742281 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 276/529] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:30.258692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:30.259307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:30.267403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.267403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.267403 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.267678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.267953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.268374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.406906 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.414320 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4020c761-5da2-4525-b5df-e16d9b54b9b1 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.159451 Aug 07 01:20:30.414895 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 254/530] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:30 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:30.544025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:30.544723 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:30.551528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.552075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.552518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.556388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.556388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.556388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.672797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:30.673407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:30.680392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.680878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.681478 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.682197 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.682949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.683392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.694077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.702244 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f57a4feb-d609-4db5-b689-2c3d9712f65a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.163388 Aug 07 01:20:30.703449 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 277/531] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:30 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:30.765923 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:30.766679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:30.773979 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.774309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.774737 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.775814 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.776270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.776782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.822285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.833745 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0a1df6c5-a262-412a-93c5-717f40db3ea2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.165200 Aug 07 01:20:30.834530 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 255/532] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:30 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:30.933578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.941878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.943299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.944453 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3a19e952-fda6-40e0-ab90-70651db6e407 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.183334 Aug 07 01:20:30.945006 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 278/533] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:30 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:31.436121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.436724 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.443705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.444178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.444603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.445280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.445725 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.446164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.575744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:31.583011 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c01a9031-af5f-40a0-9d07-b814f6c6c08a tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.151414 Aug 07 01:20:31.583568 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 256/534] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:31.723748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.724367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.730334 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.731322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.731731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.732412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.732857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.733276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.856388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.857001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.861610 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:31.863314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.863809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.864238 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.864936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.865388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.865805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.869529 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f02f5372-b16b-4076-9233-9e17e36d0f87 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.149501 Aug 07 01:20:31.870008 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 279/535] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:31.969985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.970519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.977040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.977525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.978538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.978705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.979137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.979562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.002094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.009922 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-520ab80c-a80d-4fa9-9d51-9ed144f51131 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.158157 Aug 07 01:20:32.010496 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 257/536] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:32.109947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.118122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.119617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.120794 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fb2e8e5f-50d6-4d0c-ad34-22bf7b16d503 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.155743 Aug 07 01:20:32.121369 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 280/537] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:32.604436 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:32.605045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:32.616871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.616871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.616871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.616871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.617217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.617217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.745280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.754585 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ecda594f-b974-458a-92f8-fc0c30a45695 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.154636 Aug 07 01:20:32.755176 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 258/538] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:32 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:32.892118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:32.892705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:32.898722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.899225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.899660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.900354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.900803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.901228 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.031343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.031954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:33.037398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.038052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.038541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.038982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.039677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.040129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.040550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.046351 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7714aea7-aa9c-41f4-8d2c-e5b35250a9e9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.158165 Aug 07 01:20:33.046923 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 281/539] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:32 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:33.143803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.144338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:33.150686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.151187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.151623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.152356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.152882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.153392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.175529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.183839 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-16eb59ea-704a-437f-aa8f-9daa13545a50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.156295 Aug 07 01:20:33.185319 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 259/540] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:33.303466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.311018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.312703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.313866 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b3cf57a6-0767-455b-8274-1f53de92cdab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1744 microversion: 2.20 time: 0.174291 Aug 07 01:20:33.314722 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 282/541] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:33.778791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.782080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:33.787458 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.788035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.789330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.790297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.791287 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.791870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.935023 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.943033 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9650c7cc-66c9-48a9-b679-fcc507e64672 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.168718 Aug 07 01:20:33.943653 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 260/542] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:34.067949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.069351 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.076304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.077015 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.077623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.078594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.079339 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.079928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.206796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.207391 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.214138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.214617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.215579 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.216473 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.216921 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.217422 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.236538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.247227 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0a58068b-e717-4a8a-bdcc-8ced364c660b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.182999 Aug 07 01:20:34.260179 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 283/543] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:34.336502 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.337137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.344938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.345454 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.345921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.346644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.347101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.347534 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.363449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.373928 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ba1b907b-7a84-419a-a663-f64918135f78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.170657 Aug 07 01:20:34.389019 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 261/544] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:34.522922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.533967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.535799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.537148 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d4690d5b-b74d-49a6-9674-4fbd5b56a3a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.204547 Aug 07 01:20:34.537903 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 284/545] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:34.963923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.964676 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.972000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.972528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.972964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.973662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.974184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.974617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.112012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.120105 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f8d95c4e-e3f8-4f17-98a7-1a6003e969e5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.160107 Aug 07 01:20:35.120680 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 262/546] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:35.268133 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:35.268764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:35.275233 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.275721 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.276188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.276905 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.277390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.278421 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.396926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:35.397778 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:35.405571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.406467 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.407158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.408308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.409069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.410588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.461450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.471583 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4cee1d29-33b7-40b2-8e6d-635168b920ff tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.207248 Aug 07 01:20:35.472543 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 285/547] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:35 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:35.561767 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:35.562611 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:35.564061 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.573083 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-75fe1da6-10c5-4159-ac2a-709c8868112c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.181148 Aug 07 01:20:35.574111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.576050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.576704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.578247 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 263/548] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:35 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:35.578616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.579908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.580557 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.720938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.730800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.732379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.733563 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d09850ae-b47b-4209-a84c-9e104819557e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.176322 Aug 07 01:20:35.742601 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 286/549] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:35 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:36.141274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.142832 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.150767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.151748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.152672 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.153540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.154300 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.154870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.316993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.319626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9895dba3-213a-4b25-9da6-51dcc33f9806", "name": "network-vif-plugged", "status": "completed", "tag": "d751ccb6-f7f1-4072-806a-a1916f498e12"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:36.334925 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-87609d25-399b-4688-87f7-e2dbb0cb1d13 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.198002 Aug 07 01:20:36.338719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.339416 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 264/550] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:36.340087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.340825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.354838 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] Creating event network-vif-plugged:d751ccb6-f7f1-4072-806a-a1916f498e12 for instance 9895dba3-213a-4b25-9da6-51dcc33f9806 on hv-cinder-maste Aug 07 01:20:36.360522 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-379b8f0f-3501-41ce-9483-a99a370546c3 req-93e137ba-9936-4b98-b838-561dc42afb8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048136 Aug 07 01:20:36.361152 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 287/551] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:36.498530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.500609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.508984 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.510502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.511131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.511886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.512345 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.512764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.596566 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.597268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.603676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.605743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.605743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.605743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.606969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.607550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.705874 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.718596 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d4dcf0bb-2a5b-4bb1-9e1f-c9d996ad6329 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1510 microversion: 2.1 time: 0.225090 Aug 07 01:20:36.719185 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 265/552] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:36.762887 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.763624 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.765780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.774113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.774835 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.775424 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8c00aed7-f5df-4c87-b0bc-cffee4a90cc4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.183120 Aug 07 01:20:36.775725 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.776405 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 288/553] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:36.792142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.793010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.793723 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.974820 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.985101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.986652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.987820 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b948f7ec-1557-4abe-aba5-2cae43099e77 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.229470 Aug 07 01:20:36.988386 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 266/554] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:37.360119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.360858 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.367010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.367776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.368373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.369232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.369872 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.370444 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.394543 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:37.519726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:37.530822 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-34ccffe0-4624-45ce-be7c-e787126b9768 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.172186 Aug 07 01:20:37.530822 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 289/555] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:37.740678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.742360 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.749363 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.750196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.751037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.752267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.752942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.753652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.803232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.804284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.810864 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.812032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.812695 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.814392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.815050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.815656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.070233 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.083836 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1d7311de-b1f8-4a5f-8833-08abec620c1d tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.284619 Aug 07 01:20:38.084955 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 290/556] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:38.090680 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:38.091218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:38.098052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.102576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.103154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.103594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.104596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.105066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.105648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.107203 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-473cf5b0-3764-4e8b-a409-a04b3ae2f59e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1516 microversion: 2.1 time: 0.370534 Aug 07 01:20:38.122254 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 267/557] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:38.275608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.284380 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.286028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.287267 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-cdec6b59-2538-45c1-9a92-80426da674a5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.201309 Aug 07 01:20:38.288091 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 291/558] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:38 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:38.549910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:38.550452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:38.557255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.561736 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.561736 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.561736 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.561736 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.562109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.802036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.802036 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c77206f0-21fa-4bd3-9cfd-fb05971d4bf3 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.178065 Aug 07 01:20:38.802036 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 268/559] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:38 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:39.110202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:39.111237 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:39.117302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.117821 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.118291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.119016 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.119478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.119932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.252612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.260427 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-61d650a8-f099-4bdc-bab2-b5e90c8038ab tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.156312 Aug 07 01:20:39.260991 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 292/560] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:39 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:39.311096 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:39.311698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:39.318360 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.318866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.319297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.319984 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.320429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.320844 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.466129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.474870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.476376 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.477761 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-04175964-8412-4195-9366-9c90b40e3fbe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.170857 Aug 07 01:20:39.478698 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 269/561] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:39 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:39.745574 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:39.746271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:39.753072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.753555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.754025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.754711 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.755163 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.755577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.914162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.925760 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8de5c92a-1405-4878-9cb3-678b2e0274d5 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1314 microversion: 2.1 time: 0.183935 Aug 07 01:20:39.926793 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 293/562] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:39 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:40.281623 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.282319 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.288213 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.288695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.289129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.289817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.290291 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.290709 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.295673 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:40.429070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:40.440849 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-61541420-9040-4999-a4d1-71bd01f32bc7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.163204 Aug 07 01:20:40.441428 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 270/563] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:40.502457 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.503052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.509466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.510021 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.510478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.511222 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.511670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.512235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.674966 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:40.683303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:40.685613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:40.686909 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2e1eef1c-885c-4dc5-b437-f4ee49134d24 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.188431 Aug 07 01:20:40.687466 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 294/564] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:40.947030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.947612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.960665 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.961152 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.961584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.962342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.962795 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.963215 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.120474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.128515 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-03d26218-f891-473a-898f-959fe2e44518 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1499 microversion: 2.1 time: 0.185453 Aug 07 01:20:41.134547 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 271/565] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1499 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:41.469761 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.470418 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.489342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.489860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.490296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.491004 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.491491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.491922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.565759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-07fe0ee2-0d50-488c-b093-f7ff928d376b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: .version_select at 0x7fb7d153faf0>, body: {"keypair": {"name": "tempest-keypair-526621246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAivMSymDMI/WaL6BezrkBBf5BTueYnOu6DYhoeiHarIxfjVUnHjwFGt14UBxttrnHrlfv7f6Nb+aPFb/fh+5gThGt1/DjxMn9NXy7SJdH+cIk/gLJHXBcs6qjf5xgTytA=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:41.589743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-07fe0ee2-0d50-488c-b093-f7ff928d376b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for project 32cc230c70b341fca95fa1b962d73909. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:41.594431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:41.595498 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-07fe0ee2-0d50-488c-b093-f7ff928d376b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for user 75266a74abbb4129bac206a7d5944466 and project 32cc230c70b341fca95fa1b962d73909. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:41.655787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.667900 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f4aa92e0-24fc-4775-a993-0130532f4a48 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.203114 Aug 07 01:20:41.669182 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 295/566] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:41 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:41.710963 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.711852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.718654 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.721365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.721365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.721365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.721365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.721726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.817781 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-07fe0ee2-0d50-488c-b093-f7ff928d376b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256539 Aug 07 01:20:41.818906 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 272/567] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:20:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:41.876636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.886066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.888309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.889646 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3da88e5b-3d8c-4ec7-9f2b-9a00484cc26e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.183054 Aug 07 01:20:41.890552 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 296/568] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:41 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:42.382878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.383886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.392606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.393108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.393545 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.394291 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.402666 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.403111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.430834 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:42.688815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.689445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.695346 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.695819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.696247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.696928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.697399 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.697817 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.835521 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:42.844613 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-14380506-5d8b-40ea-a43e-d466ebc08e55 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1725 microversion: 2.1 time: 0.159820 Aug 07 01:20:42.845197 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 297/569] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:42 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:42.913207 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.913813 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.923114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.923922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.924526 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.925706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.926384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.927058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.070608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.070608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.070881 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.070989 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7cb6bf85-4084-47dd-88e2-b3e62881fd28 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.161638 Aug 07 01:20:43.071469 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 298/570] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:42 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:43.254735 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dc662481-9448-4863-b657-01809c1f634e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 204 len: 0 microversion: 2.1 time: 0.875909 Aug 07 01:20:43.256095 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 273/571] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:42 2022] DELETE /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:43.267906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:43.267906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:43.274043 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.274533 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.275088 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.276234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.276695 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.277123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.456149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.470322 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1e2df38d-ed72-477a-a64d-5770e27710b0 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1505 microversion: 2.1 time: 0.208731 Aug 07 01:20:43.471654 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 299/572] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:43 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:43.866767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:43.867412 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:43.876620 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.877374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.879759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.880851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.881513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.882122 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.031250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.039776 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8d7a129c-f6a3-4a80-bb34-ebf4869ca972 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1702 microversion: 2.1 time: 0.177286 Aug 07 01:20:44.054346 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 274/573] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:43 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1702 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:44.063887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:44.070963 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.071434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.071866 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.097516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:44.099078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:44.115407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.116206 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.117521 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.119851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.120465 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.121946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.146375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Going to try to start instance {{(pid=118310) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:20:44.307752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.317094 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.318637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.319970 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98506301-f5e0-4cf4-8f09-17e46bb51c7f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.228364 Aug 07 01:20:44.336230 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 275/574] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:44 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:44.407328 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6df82b5e-f9c2-4b06-bd33-38ffecdc5b7f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action" status: 202 len: 0 microversion: 2.1 time: 0.348835 Aug 07 01:20:44.408472 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 300/575] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:44 2022] POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:44.416511 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:44.417117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:44.423282 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.423770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.424202 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.424892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.425342 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.425759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.493557 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:44.494843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:44.504704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.505051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.505387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.506687 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:44.506687 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:44.506978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:44.609531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.627834 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fb232b90-2211-46c1-9ef7-e4dec32846d8 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1711 microversion: 2.1 time: 0.215053 Aug 07 01:20:44.628543 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 276/576] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:44 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1711 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:44.739268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:44.752406 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1080eaa3-beef-4509-9542-15ec26c80bcd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1505 microversion: 2.1 time: 0.263355 Aug 07 01:20:44.753585 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 301/577] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:44 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:45.345266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:45.346017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:45.353356 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.356307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.356307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.356307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.356307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.356848 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.536575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-697784493", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64fc81ca-9ca8-4143-8113-346f57e8b724"}], "security_groups": [{"name": "tempest-securitygroup--915031890"}], "key_name": "tempest-keypair-526621246", "user_data": "}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:45.662147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] validate_networks() for [('64fc81ca-9ca8-4143-8113-346f57e8b724', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:45.990371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.004241 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.006384 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.009716 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3068da23-9d86-46db-b653-1808159b3475 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.670016 Aug 07 01:20:46.012838 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 277/578] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:45 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:46.020925 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:46.021919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:46.030392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.031185 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.031814 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.032706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.033436 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.034006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.191743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:46.192198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:46.192696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:46.193109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:46.193558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:46.205307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.239123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.239123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.239123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.239123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.239671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.239671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:46.251882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Getting quotas for user 75266a74abbb4129bac206a7d5944466 and project 32cc230c70b341fca95fa1b962d73909. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:46.274408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:46.279416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:46.279416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:46.324926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.358435 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e3b5a4f4-d72b-46dd-b731-9e9373e007d0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1711 microversion: 2.1 time: 0.344111 Aug 07 01:20:46.370306 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 278/579] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:46 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1711 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:46.370306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:46.370306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:46.375755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.376255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.376721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.377500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.378008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.378420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.479201 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-916418d4-0b0e-480f-9246-8ebf5014a972 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.947224 Aug 07 01:20:46.486612 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 302/580] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:20:46.491758 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-081689b5-c836-489f-9c1f-6ca764d2941d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:46.492374 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-081689b5-c836-489f-9c1f-6ca764d2941d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:46.560329 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-081689b5-c836-489f-9c1f-6ca764d2941d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.568663 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-081689b5-c836-489f-9c1f-6ca764d2941d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1244 microversion: 2.1 time: 0.080859 Aug 07 01:20:46.585889 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 303/581] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:46 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:46.756149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.765951 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f5ad246e-25a7-45a4-90c9-d53391fe3690 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1505 microversion: 2.1 time: 0.405338 Aug 07 01:20:46.766768 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 279/582] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:46 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:47.034122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.034683 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.040946 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.041471 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.041994 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.042740 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.043347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.043838 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.187754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.195971 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.197532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.198822 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a609f3b7-91e3-4b55-a2bf-e7215250ac8f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.168912 Aug 07 01:20:47.201868 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 304/583] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:47.325822 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9895dba3-213a-4b25-9da6-51dcc33f9806", "name": "network-vif-deleted", "tag": "d751ccb6-f7f1-4072-806a-a1916f498e12"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:47.343584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.344103 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.344543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.359398 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] Creating event network-vif-deleted:d751ccb6-f7f1-4072-806a-a1916f498e12 for instance 9895dba3-213a-4b25-9da6-51dcc33f9806 on hv-cinder-maste Aug 07 01:20:47.365111 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-fea0a2d9-9a86-45db-940b-6ea9174374ad req-5ca4317c-8ac5-4774-adde-d3ba20a21306 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043049 Aug 07 01:20:47.366087 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 280/584] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:47.382775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.383504 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.392180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.392700 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.393130 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.393819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.394445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.395048 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.582923 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.594934 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-73d1c955-77c0-44cc-a3c0-3e42273fab3f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1711 microversion: 2.1 time: 0.216090 Aug 07 01:20:47.605862 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 305/585] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1711 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:47.607175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-614771ca-1313-4b36-af7b-5a08e64346b8 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.610879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-614771ca-1313-4b36-af7b-5a08e64346b8 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.670627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-614771ca-1313-4b36-af7b-5a08e64346b8 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.677519 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-614771ca-1313-4b36-af7b-5a08e64346b8 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1244 microversion: 2.1 time: 0.086172 Aug 07 01:20:47.678505 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 281/586] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:47.788780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.789566 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.796093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.796846 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.797458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.798347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.798962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.799664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.876617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.876617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:47.881170 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-52bbdf6f-81d8-4b44-b81b-7421acaa368e tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1299 microversion: 2.1 time: 0.096440 Aug 07 01:20:47.882255 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 306/587] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:48.222498 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.223108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.229138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.229613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.230073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.231259 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.231712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.232181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.375802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.384219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.385737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.386938 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eed09c9a-44ea-4468-a3ff-2df85dc6a6fb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.168423 Aug 07 01:20:48.387495 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 282/588] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:48.618049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.618650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.625500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.630857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.630857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.630857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.630857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.631202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.699343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.700041 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.706314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.706796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.707224 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.707914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.708364 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.713179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.759310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.768152 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e9a9d510-a68e-47a3-9009-11c5d2adb497 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1715 microversion: 2.1 time: 0.154206 Aug 07 01:20:48.768722 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 307/589] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:48.776868 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.784991 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3f78420c-2f94-4709-85fb-7d67543300d4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1248 microversion: 2.1 time: 0.089588 Aug 07 01:20:48.785549 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 283/590] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:48.902321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.903778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.909891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.910382 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.910818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.911511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.911991 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.912415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.942843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.943347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.943777 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.944218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lazy-loading 'fault' on Instance uuid 9895dba3-213a-4b25-9da6-51dcc33f9806 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:48.984643 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefeb892ad9e4f219d3b7129efe4a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03f1b485f44bd682faa9ef77a3557c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.992215 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b6400834-60d3-435a-9ed0-9734a78b3e35 tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 200 len: 1304 microversion: 2.1 time: 0.093751 Aug 07 01:20:48.992777 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 308/591] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:49.408543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:49.409156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:49.415749 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.416228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.416658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.417347 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.417799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.418248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.556275 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.565036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.566660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.568436 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-166142eb-2f00-480c-966a-c3dad0000bfa tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1739 microversion: 2.20 time: 0.163175 Aug 07 01:20:49.568436 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 284/592] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:49 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:49.805678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:49.806242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:49.812904 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.813381 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.813812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.814520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.814977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.815394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.880960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.888463 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3fc6f1a5-60ed-461f-9d19-679673772392 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1296 microversion: 2.1 time: 0.086757 Aug 07 01:20:49.889025 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 309/593] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:49 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:50.013434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:50.014070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] [instance: 9895dba3-213a-4b25-9da6-51dcc33f9806] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:50.020070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.020609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.021035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.021723 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.022204 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.022629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.037756 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] HTTP exception thrown: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Request method failure captured: Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 HTTP/1.1 Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xMVrbZunQ3qEIr5NM3ZHozyoE_dDsz_e5g0qeE1ulVy9WkTuKc54x29QtIyYlCH0wtGRVho13bhwp-Ljkbp8ZlNMLyT5IsRDE22cVdvsxoaZSs-ZDM1dI1Pol3R3CBi--TiLnYfXdDC2R_Q375MVEGwqTIy31YzWQ7m1CNpq2eQiXQ Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: da03f1b485f44bd682faa9ef77a3557c Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:20:50.046054 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da03f1b485f44bd682faa9ef77a3557c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da03f1b485f44bd682faa9ef77a3557c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: da03f1b485f44bd682faa9ef77a3557c Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesActionsTest-2144237571 Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesActionsTest-2144237571-project Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: cefeb892ad9e4f219d3b7129efe4a994 Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesActionsTest-2144237571-project Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. Aug 07 01:20:50.047537 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '9895dba3-213a-4b25-9da6-51dcc33f9806'} Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:50.048417 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. Aug 07 01:20:50.049870 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:20:50.051138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] Returning 404 to user: Instance 9895dba3-213a-4b25-9da6-51dcc33f9806 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:50.051138 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a550cfe6-2d87-4d59-b667-36673f69a5cd tempest-VolumesActionsTest-2144237571 tempest-VolumesActionsTest-2144237571-project] 10.222.0.36 "GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806" status: 404 len: 111 microversion: 2.1 time: 0.031110 Aug 07 01:20:50.051138 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 285/594] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers/9895dba3-213a-4b25-9da6-51dcc33f9806 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:20:50.590914 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:50.591613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:50.599428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.599428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.599428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.599428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.599833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.600179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.743216 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.752919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.754467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.755627 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4e16177c-07cc-4a14-a501-6d38f82a303e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1721 microversion: 2.20 time: 0.169605 Aug 07 01:20:50.756182 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 310/595] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:50.914576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:50.915192 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:50.922129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.922687 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.923211 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.923976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.924500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.924988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.007823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:51.016680 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-23eaaf7d-b8b7-45ed-8135-3860866f6fc4 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1304 microversion: 2.1 time: 0.106057 Aug 07 01:20:51.017581 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 286/596] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:51.783835 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:51.784423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:51.790470 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.790954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.791387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.792077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.792525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.792947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.922640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:51.930456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:51.931960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:51.933114 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dc75792e-d3ed-4921-89e1-f2a5231da32a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1721 microversion: 2.20 time: 0.153346 Aug 07 01:20:51.933667 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 311/597] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:51 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:52.037627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:52.038263 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:52.044653 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.045134 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.045565 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.046283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.046731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.047152 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.058563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "name": "network-vif-unplugged", "status": "completed", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:52.069018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.069604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.070149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.082337 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] Creating event network-vif-unplugged:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:20:52.087431 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-f4996925-211f-4980-a3db-bf109feaeb83 req-01feab6c-e3b8-4985-b8e1-926072f809ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032550 Aug 07 01:20:52.089696 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 312/598] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:52.112958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:52.119352 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-09a2b447-19d2-4666-9c95-14a4bc7e655f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1314 microversion: 2.1 time: 0.085576 Aug 07 01:20:52.119910 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 287/599] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:52 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1314 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:52.959057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:52.959853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:52.967486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.968076 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.968857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.969858 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.970390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.971027 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.135288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.141921 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:53.144684 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:53.145973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.153694 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.154441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.154880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.155705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.156168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.156690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.156801 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.158078 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-75816aeb-2058-47f7-ae35-0840ce30cf25 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1721 microversion: 2.20 time: 0.205912 Aug 07 01:20:53.158882 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 313/600] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:52 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:53.175524 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:53.244099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.252145 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ed092d74-b8a7-41da-a494-7280ece0215f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1302 microversion: 2.1 time: 0.115423 Aug 07 01:20:53.252722 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 288/601] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:53 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:54.184374 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.186001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:54.192333 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.193067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.193672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.194576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.195188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.195772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.276130 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.278744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:54.295254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.299527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.299527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.299527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.301683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.302406 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.377107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.387547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.393080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.395653 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d5faaa1f-7284-428d-8f17-94607b9c7f45 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1664 microversion: 2.20 time: 0.216566 Aug 07 01:20:54.397391 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 314/602] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:54 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:54.422935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68dc021d-1112-44b8-9ab2-cf1f59b8b995"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:54.425628 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:54.431935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.432615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.433213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.434280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.435072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.435733 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.551547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.564898 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-01d2c38f-0d57-450e-8e56-a24881a88ddb tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.294861 Aug 07 01:20:54.565815 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 289/603] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:54 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:54.916088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:54.929677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.932405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.933030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.948363 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] Creating event network-changed:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:20:54.955468 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f5875fe5-35b5-41df-b8e0-51c13a08a023 req-5e4b3d9c-4dfe-4622-9630-7019b4ca8e26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043023 Aug 07 01:20:54.956319 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 290/604] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:55.587120 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:55.588611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:55.598987 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.599842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.601191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.602256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.602966 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.603683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.813318 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-171bcb02-4724-44e8-80ec-1296a57a8815 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.384805 Aug 07 01:20:55.813318 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 315/605] 10.222.0.36 () {62 vars in 1364 bytes} [Sun Aug 7 01:20:54 2022] POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments => generated 188 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:20:56.085894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.114140 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3bd50533-d312-4108-95d9-946426923195 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.529572 Aug 07 01:20:56.114763 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 291/606] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:55 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:56.190053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:56.191451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.197560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.198714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.199962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.200881 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.201769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.202423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.221166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:56.256980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118310) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:20:56.565594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=8 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:56.672618 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ecabc289-42c5-4e95-83ab-40c2779a9500 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/action" status: 202 len: 0 microversion: 2.20 time: 0.481332 Aug 07 01:20:56.672618 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 316/607] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Aug 7 01:20:56 2022] POST /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:56.680032 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:56.681519 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.690212 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.690915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.691618 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.692483 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.693142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.693728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.857982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.875982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.878000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.879564 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7b8e6c31-0662-4848-8a29-ac1970c21613 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1750 microversion: 2.20 time: 0.203806 Aug 07 01:20:56.881136 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 292/608] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:56 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:57.141919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.144994 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.159698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.161358 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.162433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.163688 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.164910 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.166178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.341119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:57.350040 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-233ade75-34e7-48af-aeec-62f4efc6638e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.215113 Aug 07 01:20:57.350737 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 317/609] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:57 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:57.908485 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.909550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.916365 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:57.920014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.920507 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.921199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.923195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.925524 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.926315 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:58.097959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.110648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.112644 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.114651 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e8799c65-78ba-43df-9f01-81dc60bf6c93 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1750 microversion: 2.20 time: 0.214115 Aug 07 01:20:58.115390 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 293/610] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:57 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:58.371860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:58.373198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:58.380312 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:58.380976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:58.381540 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:58.382406 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:58.383432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:58.384060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:58.541685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.551703 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e30750b4-17ec-476b-8733-e2a53e7a6fdd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.184276 Aug 07 01:20:58.552998 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 318/611] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:58 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:59.139531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:59.140146 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:59.147188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.147681 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.148110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.148823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.149270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.149689 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.299611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:59.305531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:59.307396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:59.312833 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-88755859-8d8c-4402-9d77-66fd7a3beb94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1750 microversion: 2.20 time: 0.174005 Aug 07 01:20:59.312833 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 294/612] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:59 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:59.572501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:59.573078 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:59.579621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.580100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.580529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.581224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.581675 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.582117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.726003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:59.735822 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-adaf18cc-2a9e-46fe-895c-9e46cc319363 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.167043 Aug 07 01:20:59.736617 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 319/613] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:59 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:00.335058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:00.336288 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:00.345747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.348025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.348025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.348025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.348643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.349163 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.509752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.519454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.521284 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.522694 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e981ee5c-7da1-4bc2-839f-59f12c37d35d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1752 microversion: 2.20 time: 0.192953 Aug 07 01:21:00.539340 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 295/614] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:00 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:00.769473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:00.770093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:00.776411 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.777137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.777809 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.779103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.779694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.780070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.782878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:00.934970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.950600 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-18159552-9c51-44c4-8a99-48ab942f5043 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.183844 Aug 07 01:21:00.952174 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 320/615] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:00 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:01.547463 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:01.548069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.555324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.555997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.556660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.557546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.558025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.558662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.698474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.708158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.710089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.711390 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ee87e4b1-992c-41b5-9d14-bc4e57ffb58f tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1752 microversion: 2.20 time: 0.168448 Aug 07 01:21:01.712511 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 296/616] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:01 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:01.978269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:01.979497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.989469 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.990354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.990919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.991887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.992408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.992908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.165495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.177452 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dcccb638-9ce5-44b0-9195-fd1082db91c5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.204280 Aug 07 01:21:02.202840 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 321/617] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:01 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:02.624306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "name": "network-vif-plugged", "status": "completed", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:02.635440 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.636044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.636668 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.649162 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] Creating event network-vif-plugged:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:21:02.654711 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-ee60a3c1-172e-4ce1-a03e-bb306519e3e9 req-d765fe0f-f2e7-4674-bbd9-93a27fd660fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Aug 07 01:21:02.655365 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 297/618] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:02.737429 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:02.738198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:02.745495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.749154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.749154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.749154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.749154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.750808 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.940405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.961146 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.970795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.971977 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-90097cfb-cbfc-4091-8454-c9d8ca9e8265 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.238456 Aug 07 01:21:02.995330 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 322/619] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:02 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:03.207894 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:03.209045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:03.220229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.221155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.221803 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.222548 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.223228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.223654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.523659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:03.532024 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0ece5ac9-1853-4ba0-88a7-76c26e627775 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.328480 Aug 07 01:21:03.533028 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 298/620] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:03 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:04.000810 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:04.001572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:04.009316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.010386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.011201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.012898 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.013562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.014218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.191762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.202341 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.204444 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.205992 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2b60d296-2f21-4e5b-8fbc-70347f6ba7e3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.210832 Aug 07 01:21:04.207060 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 323/621] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:03 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:04.552636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:04.553985 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:04.560942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.562602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.562602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.563100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.563741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.564233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.714797 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.723278 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1f8a06d4-0bc3-4772-a686-985f30a94730 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.174426 Aug 07 01:21:04.736912 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 299/622] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:04 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:05.239909 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.242524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:05.251212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.252236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.252842 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.253759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.254531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.254962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.446305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.457778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.462574 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.464695 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-cdb055f1-1028-46ad-9aad-be81acee8be9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.235629 Aug 07 01:21:05.482064 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 324/623] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:05 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:05.746634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.748026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:05.755503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.756352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.756864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.757656 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.758201 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.758891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.916430 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.937280 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99bb0f68-c9d3-4378-984c-72e1270a00b9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1369 microversion: 2.1 time: 0.194544 Aug 07 01:21:05.942942 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 300/624] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:05 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:06.491330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:06.492940 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:06.503133 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.504063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.504824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.505682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.506490 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.506967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.672059 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:06.681951 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:06.684295 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:06.685664 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1d60ac2e-169b-48cd-a868-231c816f28b3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.199432 Aug 07 01:21:06.686256 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 325/625] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:06 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:06.970956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:06.972409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:06.995666 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.997243 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.997815 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.998925 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.999550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.000088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.163071 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.171767 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-581edcd9-a0f2-46e3-b859-caeefc3180ac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1564 microversion: 2.1 time: 0.205587 Aug 07 01:21:07.173123 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 301/626] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:06 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:07.193001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:07.193486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:07.200072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.200539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.200972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.201660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.202396 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.202819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.320837 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c94d951c-0b14-4591-b735-75592314684f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131871 Aug 07 01:21:07.321435 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 326/627] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:21:07 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:07.715225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:07.715992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:07.753464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.755619 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.756120 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.756871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.757416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.757753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.183857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.207526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.208585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.210463 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bb8e8264-7231-42ba-bcf2-d72a6448793a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.499182 Aug 07 01:21:08.211585 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 302/628] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:07 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:09.062973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:09.073630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.074834 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.075326 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.102318 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] Creating event network-changed:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:21:09.110108 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-7de82a35-2ed9-4096-b308-1a1a2d5e123b req-b9a56a17-ae6b-419b-beb8-56a2ddff89f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049591 Aug 07 01:21:09.116665 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 327/629] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:09.242512 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:09.243126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:09.251573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.252066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.252504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.253226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.253930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.254518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.403946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:09.412875 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:09.414406 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:09.415577 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6ed231de-ecd4-4902-9720-dbaac4b3ae91 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.181473 Aug 07 01:21:09.416150 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 303/630] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:09 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:10.440234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:10.440923 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:10.447105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.447513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.447935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.448619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.449065 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.450258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.609002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.617342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.618859 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.620005 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dab35482-1367-402b-85a7-dbbb88c1515b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.184070 Aug 07 01:21:10.620567 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 328/631] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:10 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:11.645181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.648628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:11.654535 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.655106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.655931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.657116 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.657817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.658597 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.807646 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.815046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.816660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.817863 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3c3831b4-bc62-484b-9da0-9a2ea82a14ab tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.176836 Aug 07 01:21:11.818428 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 304/632] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:11 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:12.841299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:12.842569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:12.848638 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.850655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.862789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.862789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.862789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.862789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.987764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:12.996691 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:12.998258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:12.999391 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-18f81804-52ca-46a5-8f48-cdaea1c18aa1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.162818 Aug 07 01:21:12.999957 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 329/633] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:12 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:14.023971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:14.024813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:14.028474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:14.034297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.034866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.035501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.046913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.047517 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.048238 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.250745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:14.250745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:14.251031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:14.251031 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a11c0141-2074-4a5e-a8e5-6aa5f2843dc5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.216255 Aug 07 01:21:14.251031 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 305/634] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:14 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:15.258543 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:15.259176 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:15.265166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.266841 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.266841 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.266841 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.267192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.267616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.406390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.415640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.416507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.417657 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ee417638-70ac-42d0-9442-3d8503f4aee7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.163158 Aug 07 01:21:15.418912 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 330/635] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:15 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:16.442071 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:16.442743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:16.450377 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.450838 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.451274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.451963 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.452683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.453104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.467490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:16.658031 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.667493 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.669916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.671344 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0d6ee9d4-1cb9-4d20-a044-183749aca5e8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.233526 Aug 07 01:21:16.672547 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 306/636] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:16 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:17.695948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:17.697132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:17.710797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:17.712205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.712697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.713348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.714087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.714553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.714981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.899187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:17.919455 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:17.920967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:17.922170 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4d7aa997-e159-4096-a6ab-d0209394a155 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.230458 Aug 07 01:21:17.922739 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 331/637] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:17 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:18.944627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:18.945190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:18.953017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.953504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.953973 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:18.954672 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.955127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.955555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:19.083681 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.092801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.094447 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.095652 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1d721c6c-f4e1-45b1-ad39-0ab9b5c1543d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.155024 Aug 07 01:21:19.096217 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 307/638] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:18 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:20.120525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:20.121167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:20.127196 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.127705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.128143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.128832 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.129278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.129698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.259007 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:20.267870 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:20.272440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:20.272440 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-56a081d4-14eb-4504-a17f-b66dda0e201e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.153946 Aug 07 01:21:20.272440 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 332/639] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:20 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:21.295638 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:21.296153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:21.303167 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.303655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.304095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.304786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.305268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.305692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.432986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.441347 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.442864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.444000 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-52c05b87-a59e-4d91-b93f-70cc240a6f04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.153208 Aug 07 01:21:21.444554 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 308/640] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:21 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:22.466868 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:22.467447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:22.473419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.473920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.474351 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:22.475035 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.475477 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.475895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:22.617509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:22.626729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:22.628223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:22.629380 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-39d25a53-75f1-41ba-b226-e9ec75aa3dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.166489 Aug 07 01:21:22.629950 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 333/641] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:22 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:23.652915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:23.653528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:23.660050 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:23.660523 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:23.660949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:23.661628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:23.662097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:23.662516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:23.789458 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.798001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.799575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.800736 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-28bb41ec-b759-4722-8084-d502c451aeae tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.152194 Aug 07 01:21:23.801295 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 309/642] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:23 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:24.824116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:24.825216 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:24.831812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.832286 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.832715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.833401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.833872 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.834291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.960973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:24.970259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:24.971787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:24.972977 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-88822c9d-9269-4086-8188-df844ed62cf1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.152792 Aug 07 01:21:24.973533 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 334/643] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:24 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:25.995977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:25.997930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:26.003186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.003662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.004093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.004767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.005212 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.005625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.131499 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:26.139948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:26.141417 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:26.142594 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4204be2b-a1b1-47af-a81a-018cc85eb296 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.150499 Aug 07 01:21:26.143148 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 310/644] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:25 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:27.165849 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:27.166479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:27.172961 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.173445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.173906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.174590 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.175040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.175461 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.314573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.323735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.325780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.327101 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5b3c86a9-9006-45fa-98bb-cb14b2454f35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.165162 Aug 07 01:21:27.327914 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 335/645] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:27 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:28.350762 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:28.351379 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:28.358759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:28.359246 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:28.359714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:28.360410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:28.360860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:28.361284 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:28.496256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.506405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.507918 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.509124 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d42a13dc-e01f-43ec-8b5f-ff7d694b6c32 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.162296 Aug 07 01:21:28.510139 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 311/646] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:28 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:29.532491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:29.533094 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:29.539308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.539795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.540230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:29.540953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.541400 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.541822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:29.671540 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:29.680022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:29.681524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:29.682698 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-db1e30dc-8ca4-4420-9b21-4f7d5ea9ba4a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.154106 Aug 07 01:21:29.683259 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 336/647] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:29 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:30.704935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:30.705540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:30.711522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.712003 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.712441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.713110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.713560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.714012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.805562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "name": "network-vif-plugged", "status": "completed", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:30.816755 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.817235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.817697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.828979 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] Creating event network-vif-plugged:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:21:30.834011 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-1eb5358f-1621-4902-923c-2b042efe6fe0 req-d7d07d02-9596-41e6-9b9e-a018e4e6923a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Aug 07 01:21:30.834558 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 337/648] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:21:30.846044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.854358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.856466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.857607 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d2c60225-5a09-4849-bfba-3e6332abfff9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.156978 Aug 07 01:21:30.858197 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 312/649] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:30 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:31.881208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:31.881809 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:31.888890 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.889368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.889804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.890510 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.890961 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.891386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.905567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=100 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:32.025411 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:32.033798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:32.035308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:32.036451 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c1ab4d41-44c8-4798-8281-c32b6fa82041 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.159601 Aug 07 01:21:32.037173 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 338/650] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:31 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:33.059320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:33.059925 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:33.066605 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.067101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.067526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.068219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.068692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.069114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.194888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:33.204156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:33.205655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:33.206840 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ae04af46-dbc8-43cb-924c-60585133f383 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.151669 Aug 07 01:21:33.207396 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 313/651] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:33 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:34.230014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:34.230622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:34.237107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:34.237584 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:34.238047 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:34.238728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:34.239206 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:34.239627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:34.367433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:34.376075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:34.377572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:34.378763 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d9855d01-6e31-4180-aba0-ce3864a913e7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.152711 Aug 07 01:21:34.379314 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 339/652] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:34 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:35.402001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:35.402610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:35.408982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.409486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.409939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.410620 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.411064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.411479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.541606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:35.550524 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:35.552026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:35.553222 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-56cca585-5b88-4397-92c2-6c5311cef02b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.155118 Aug 07 01:21:35.553779 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 314/653] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:35 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:36.577151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:36.577754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:36.584054 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.584539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.584974 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.585715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.586198 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.586623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.715820 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:36.724160 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:36.725665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:36.726846 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-511a844b-08b0-4553-be0d-407cc47e577c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1808 microversion: 2.20 time: 0.154239 Aug 07 01:21:36.738567 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 340/654] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:36 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:37.750525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:37.751164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:37.757604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.758117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.758553 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.759242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.759692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.760113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.892331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:37.900585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:37.902114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:37.903629 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9ce62f05-b1d1-40b7-9d45-6af6b4060bca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1795 microversion: 2.20 time: 0.157187 Aug 07 01:21:37.904175 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 315/655] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:37 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:50.156591 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:50.158819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:50.160849 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=19 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:50.161506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=15 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:50.166221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.170550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.170550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:50.170550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.170550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.171039 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:50.497005 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3377fe9f-3e10-4f6c-8f8a-5d992a8d21d7 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action" status: 202 len: 0 microversion: 2.1 time: 0.344641 Aug 07 01:21:50.497936 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 341/656] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:21:50 2022] POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:21:50.505770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:50.506405 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:50.508928 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=21 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:50.509610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=57 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:50.514924 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.515407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.515835 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:50.516519 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.516963 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.517378 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:50.659007 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:50.666934 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8256f0bb-7dd6-4e91-80f0-6b8de4d01ba2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1749 microversion: 2.1 time: 0.165013 Aug 07 01:21:50.671407 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 316/657] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:50 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:51.690875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:51.691494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:51.697581 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.698097 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.698535 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.699283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.699739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.700848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.845118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:51.853940 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bf3dd53e-c86b-4e64-a17b-334b6e2a0dd4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1749 microversion: 2.1 time: 0.167349 Aug 07 01:21:51.854522 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 342/658] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:51 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:52.876213 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:52.876812 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:52.883584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:52.888051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:52.888051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:52.888051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:52.888051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:52.888587 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:53.031977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:53.039939 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d9e38d4c-3bee-4b26-9af6-025017c332de tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.168454 Aug 07 01:21:53.040506 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 317/659] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:52 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:54.061312 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:54.061929 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:54.067834 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.068310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.068734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.069409 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.069870 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.070607 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.210022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:54.218562 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1c79d6a9-545e-4a9d-a821-ccba0b2eaefe tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.161098 Aug 07 01:21:54.219126 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 343/660] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:54 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:55.240657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:55.241191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:55.249175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:55.249657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:55.250119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:55.250817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:55.251275 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:55.251701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:55.561888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:55.570088 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fbc76677-596f-46c9-849f-368e0ea8f7c2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.333367 Aug 07 01:21:55.570655 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 318/661] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:55 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:56.592101 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:56.592705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:56.598663 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:56.599147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:56.599577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:56.600265 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:56.600713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:56.601139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:56.796309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:56.804293 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dae33318-486c-4635-9cce-db263b444007 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.216644 Aug 07 01:21:56.804855 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 344/662] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:56 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:57.826701 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:57.827310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:57.834105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:57.834587 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:57.835017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:57.835699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:57.836145 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:57.836841 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:57.979951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:57.988144 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c50a0a8-47d1-438d-8f41-9a65df046d56 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.166134 Aug 07 01:21:57.988706 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 319/663] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:57 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:59.008441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:59.009040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:59.015176 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:59.015654 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:59.016081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:59.016759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:59.017206 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:59.017622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:59.158158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:59.166070 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e7758811-1bb9-4718-a2f2-b48fd4f547f8 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.161339 Aug 07 01:21:59.166849 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 345/664] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:59 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:00.188064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:00.188691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:00.195117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:00.195592 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:00.196021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:00.196706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:00.197155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:00.197573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:00.342598 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:00.350554 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f8b3077b-4fd6-4c47-9fd1-89474a77224c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.166968 Aug 07 01:22:00.351115 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 320/665] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:00 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:01.372532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:01.373159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:01.379227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.379712 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.380147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.380829 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.381289 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.381712 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.751164 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:01.759014 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4d1f660c-340e-40f8-87da-5e25dc4ecef9 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.390865 Aug 07 01:22:01.759579 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 346/666] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:01 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:02.780122 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:02.780734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:02.787230 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:02.787704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:02.788127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:02.788801 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:02.789245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:02.789661 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:02.931150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:02.939799 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-21073469-9b2a-4b42-9059-6eee0eb4fda4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.163657 Aug 07 01:22:02.940358 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 321/667] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:02 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:03.961388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:03.962029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:03.968729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:03.969206 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:03.969641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:03.970349 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:03.970802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:03.971224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.116113 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:04.118383 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c06c7119-4f00-4985-a96c-ac179c2eeb21 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.160857 Aug 07 01:22:04.118953 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 347/668] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:03 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:05.140016 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:05.140627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:05.147111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:05.147593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:05.148049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:05.148737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:05.149183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:05.149611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:05.294216 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:05.302075 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0867ce04-9e57-463c-9c06-1b42e4326af1 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.166585 Aug 07 01:22:05.302646 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 322/669] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:05 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:06.323702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:06.324365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:06.330747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.331248 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.331674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.332348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.332795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.333210 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.476498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:06.484456 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1453de6d-f6a0-4ed6-bdbb-cf698ef9e59c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.164576 Aug 07 01:22:06.485023 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 348/670] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:06 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:07.504429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:07.505038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:07.511778 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.512320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.512849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.513578 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.514057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.514476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.710479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:07.719898 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b653c86e-6873-47f2-a2f1-4e6f7a41a880 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1754 microversion: 2.1 time: 0.219203 Aug 07 01:22:07.720535 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 323/671] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:07 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:08.731677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.732358 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.738463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.738944 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.741427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.741427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.741427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.741427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.742607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.743224 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.750786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.751282 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.751723 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.752683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.753157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.753619 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.874121 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lazy-loading 'services' on Instance uuid bd406a7d-ec74-4def-981c-72d0d5d609d0 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:08.916192 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:08.926224 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fb8b101e-f543-4629-8e31-47e7e37fa801 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1757 microversion: 2.1 time: 0.187994 Aug 07 01:22:08.926829 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 324/672] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:09.146087 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ebcb3a22-7736-466d-ab6d-4bf7840850b1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments/6876ab43-f180-4af4-83c3-75510488daac" status: 202 len: 0 microversion: 2.1 time: 0.418766 Aug 07 01:22:09.146684 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 349/673] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:22:08 2022] DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments/6876ab43-f180-4af4-83c3-75510488daac => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:10.908666 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:22:10.909307 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:22:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:22:11.458311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:11.464323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.464800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.465726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.489760 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Going to try to stop instance {{(pid=118307) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:22:11.784301 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4a185081-06ad-48b8-a096-0fb6fe845a70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action" status: 202 len: 0 microversion: 2.1 time: 0.329916 Aug 07 01:22:11.785015 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 325/674] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:11 2022] POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:11.793906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:11.794777 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:11.801521 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.802077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.802512 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.803211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.803664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.804092 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.934369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:11.941796 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c27ba3ff-607c-44a8-8920-ab4dc30924a4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.152411 Aug 07 01:22:11.942376 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 350/675] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:11 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:12.964760 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:12.966037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:12.972254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.972737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.973172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.973880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.974336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.974758 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.111669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:13.119209 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3587721a-19a1-4048-89b4-8657b122222e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.159313 Aug 07 01:22:13.119767 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 326/676] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:12 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:14.140375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:14.140972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:14.147082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.147558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.147985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.148664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.149111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.149527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.278970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:14.286428 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ff924ef0-40cb-48ad-96b5-ab658abfb172 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.149987 Aug 07 01:22:14.286981 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 351/677] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:14 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:15.307383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:15.307953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:15.314433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:15.314918 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:15.315354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:15.316054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:15.316515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:15.316967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:15.446045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:15.454901 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-97e199fe-be3f-4c6c-9e93-19ffdb4f3967 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.151215 Aug 07 01:22:15.455477 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 327/678] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:15 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:16.476958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:16.477549 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:16.484243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.484720 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.485149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.485823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.486291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.486706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.613303 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:16.620727 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0605c816-c6f5-4751-9fb0-8e93fb0f3538 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.147578 Aug 07 01:22:16.621284 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 352/679] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:16 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:17.641675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:17.642343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:17.649140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.649632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.650104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.650838 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.651296 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.651720 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.791475 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:17.799433 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99152f98-1ab1-4d54-b7fa-91c061c8dc5c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.161687 Aug 07 01:22:17.800023 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 328/680] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:17 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:18.821224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.821822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:18.828416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.828888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.829315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.830394 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.830843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.831262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.957722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:18.964996 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-03c5cc77-3b44-45f1-8698-80835d7d9bb9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.147627 Aug 07 01:22:18.965653 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 353/681] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:18 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:19.986000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:19.986611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:19.992985 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.993461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.993908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.994591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.995036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.995456 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.129859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.137925 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ad90dc7e-1923-48de-a269-1d2c0ea51879 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.155361 Aug 07 01:22:20.138500 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 329/682] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:19 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:21.160148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:21.160745 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:21.162624 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=27 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:21.167249 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.168129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.169222 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:21.169953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.170402 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.170821 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:21.174731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:21.302891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:21.310381 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9cd5f357-3ade-4bd0-8412-a73123430b73 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.154228 Aug 07 01:22:21.310947 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 354/683] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:21 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:22.332198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:22.332774 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:22.335312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=29 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:22.339974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:22.341050 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:22.341480 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:22.342192 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:22.342641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:22.343057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:22.472165 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:22.480912 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-afbcd081-79aa-4143-beb7-88c0a12d80c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1679 microversion: 2.1 time: 0.153090 Aug 07 01:22:22.481816 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 330/684] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:22 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:23.502735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:23.503334 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:23.509640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.510143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.510571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.511252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.511698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.512117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.638426 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:23.645701 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a4d35677-da5f-49ab-8724-153f845a7983 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1656 microversion: 2.1 time: 0.147154 Aug 07 01:22:23.646291 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 355/685] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:23 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:23.666427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:23.673071 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.673561 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.674032 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.677386 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:23.695468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Going to try to start instance {{(pid=118307) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:22:23.959553 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-548227cd-09b1-4b44-bd08-bbb56df81827 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action" status: 202 len: 0 microversion: 2.1 time: 0.296839 Aug 07 01:22:23.960158 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 331/686] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:23 2022] POST /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:23.968754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:23.969361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:23.975499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.976002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.976441 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.977187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.977655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.978168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.111645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:24.119175 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-cd80910d-bc71-4537-9793-7aecc1b0df25 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1665 microversion: 2.1 time: 0.154727 Aug 07 01:22:24.119742 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 356/687] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:23 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:25.141412 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:25.142164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:25.148366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.148853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.149289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.150014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.150476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.150901 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.286563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:25.294042 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4d65840e-05bb-4a75-b355-3b6d59a2e81e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1665 microversion: 2.1 time: 0.157808 Aug 07 01:22:25.294617 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 332/688] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:25 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:26.315852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:26.316397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:26.322460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.322932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.323359 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.324032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.324476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.324892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.451687 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:26.459337 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7b61e0d7-adef-47cd-b0ea-30fbcb6984c2 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1669 microversion: 2.1 time: 0.147410 Aug 07 01:22:26.459897 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 357/689] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:26 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:39.313293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38b51bdb-4e5a-41c4-be92-94cc05e4e256"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:39.315635 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:39.317745 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=5 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:39.318495 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:39.323080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.323561 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.323993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.325526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.326008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.326433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.185510 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-637da02b-a9a1-493c-9d91-641261ca9ccd tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876430 Aug 07 01:22:40.186154 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 333/690] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:22:39 2022] POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:43.477025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:43.479322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:43.481423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=7 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:43.482123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=23 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:43.486959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.487510 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.487922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.488606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.489051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.489731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.512830 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'flavor' on Instance uuid e547fd5a-12b9-446a-8686-17d8c2cf3a2d {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:43.854039 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-04797bef-a319-4a79-8005-1f137e252e86 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/action" status: 200 len: 32 microversion: 2.1 time: 0.380793 Aug 07 01:22:43.855009 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 358/691] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:43 2022] POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:43.865667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:43.866461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:43.873027 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.873517 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.873976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.874674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.875126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.875549 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:44.011683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:44.020694 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7f77ac58-34e1-46b1-820f-7cf72f8ac4bc tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.159177 Aug 07 01:22:44.021316 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 334/692] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:43 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:45.043230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.043945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.050714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.051193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.051620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.052323 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.052773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.053190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.180733 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:45.188996 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-54c3177f-4491-4098-b872-f606f190f149 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.149980 Aug 07 01:22:45.189943 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 359/693] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:45.458137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.458617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.464420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.464897 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.465329 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.466653 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.467248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.467670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.497429 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1cdb689f-4b1e-4398-9fb1-6ddb0c775731 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments/68dc021d-1112-44b8-9ab2-cf1f59b8b995" status: 200 len: 194 microversion: 2.20 time: 0.273584 Aug 07 01:22:45.497926 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 335/694] 10.222.0.36 () {60 vars in 1454 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments/68dc021d-1112-44b8-9ab2-cf1f59b8b995 => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:22:45.562956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.563443 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.569194 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.569664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.570131 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.570805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.571247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.571661 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.649459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lazy-loading 'services' on Instance uuid 39ad4a4c-7d17-429f-a99a-50572de3a588 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:45.889128 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c0df2d03-aa77-475f-83a4-7f054138bd6c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments/68dc021d-1112-44b8-9ab2-cf1f59b8b995" status: 202 len: 0 microversion: 2.20 time: 0.330050 Aug 07 01:22:45.889642 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 360/695] 10.222.0.36 () {60 vars in 1457 bytes} [Sun Aug 7 01:22:45 2022] DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments/68dc021d-1112-44b8-9ab2-cf1f59b8b995 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:45.899743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.902030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.908492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.908971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.909399 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.910111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.910851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.911275 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.940963 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9ec09e31-33c4-470f-bf6d-08832b70b51b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Aug 07 01:22:45.941518 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 336/696] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:22:46.210911 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:46.211599 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:46.218297 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.218781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.219273 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.219945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.220397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.220842 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.349012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:46.357419 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4b4449a1-ee57-45c4-a093-640720fc2c68 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.150285 Aug 07 01:22:46.362533 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 361/697] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:46 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:46.955174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:46.957572 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:46.963916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.966699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.966699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.966699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.966699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.967136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.996371 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-71a554fb-ffea-4c73-b90f-1a0b52c91dea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045775 Aug 07 01:22:46.997977 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 337/698] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Aug 7 01:22:46 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:22:47.381246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:47.381884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:47.388467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.388953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.389386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.390096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.390551 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.390975 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.518247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:47.526202 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4c31553c-0e3d-4218-ace0-255ac4046508 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.148808 Aug 07 01:22:47.526772 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 362/699] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:47 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:48.008706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.010893 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.017190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.017669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.018129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.018815 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.019289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.019708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.048368 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fc609571-ca53-4099-9a43-460fcc1d532c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043657 Aug 07 01:22:48.049207 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 338/700] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:48.111397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.111889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.118070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.118546 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.118976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.119688 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.120132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.120548 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.145783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:48.415476 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b8d43cef-a9f7-482f-a1c7-53205d177d68 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 204 len: 0 microversion: 2.20 time: 0.309312 Aug 07 01:22:48.416143 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 363/701] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Aug 7 01:22:48 2022] DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 01:22:48.424527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.426839 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.431203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.431676 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.432104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.432776 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.433250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.433669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.552138 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.552833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.558938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.559426 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.559936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.560783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.561240 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.561666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.566366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.574444 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.576551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.577694 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-67039ebc-f36f-46fd-938b-0a167a49d889 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.157232 Aug 07 01:22:48.578280 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 339/702] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:48.693672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.702285 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7904141d-fc0a-4dd6-a916-52258307c962 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.158181 Aug 07 01:22:48.702851 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 364/703] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:49.601582 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:49.602210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:49.609311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.609775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.610235 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.610913 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.611358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.611774 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.724463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:49.725081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:49.730939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.731419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.732482 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.733182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.733636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.734086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.740434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:49.748550 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:49.750072 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:49.751229 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eccb4825-43b7-4a19-8925-14bc8a1e13b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.153562 Aug 07 01:22:49.752022 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 340/704] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:49 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:49.861519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:49.869458 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9f7d5077-9d43-4a68-a2f6-06d04b9a3224 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.148853 Aug 07 01:22:49.870048 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 365/705] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:49 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:50.773966 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:50.774588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:50.781579 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.782095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.782536 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.783236 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.783691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.784117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.890826 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:50.893232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:50.897467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.897994 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.898434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.899135 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.899589 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.900016 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.166075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:51.166075 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa60e91d-2d90-4a8a-93fe-2e4d780b7bf3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.167253 Aug 07 01:22:51.166075 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 366/706] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:50 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:51.166866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:51.166866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:51.167058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:51.167058 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7e9a4e28-a1b7-478c-8dc4-0bf5a259368a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1723 microversion: 2.20 time: 0.332902 Aug 07 01:22:51.167058 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 341/707] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:50 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:51.681026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad4a4c-7d17-429f-a99a-50572de3a588", "name": "network-vif-deleted", "tag": "8c471990-fb3d-440c-b63e-eb133fd33057"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:51.694893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:51.694893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:51.694893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.704271 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] Creating event network-vif-deleted:8c471990-fb3d-440c-b63e-eb133fd33057 for instance 39ad4a4c-7d17-429f-a99a-50572de3a588 on hv-cinder-maste Aug 07 01:22:51.709755 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-6bdffce0-3e51-49af-bb6b-9ff99f966b74 req-7e441513-89da-4d0a-ab17-5e1fa2763142 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093103 Aug 07 01:22:51.710506 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 367/708] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:52.075182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:52.076862 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:52.083652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.084146 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.084584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.085286 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.085808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.086265 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.128771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:52.129468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:52.139190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.139986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.140593 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.141480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.142138 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.142722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.178953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.179622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.180354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.180811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lazy-loading 'fault' on Instance uuid 39ad4a4c-7d17-429f-a99a-50572de3a588 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:52.227061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:52.238276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:52.239218 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:52.240744 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:52.241972 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1db787a4-524a-4d42-92ce-4a1c2eceaf04 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 200 len: 1371 microversion: 2.20 time: 0.118024 Aug 07 01:22:52.247145 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-df885fb6-d043-4a77-930c-159899b8b22b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.176025 Aug 07 01:22:52.248958 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 342/709] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:52 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:52.250082 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 368/710] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:52 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:53.265254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:53.265859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:53.269421 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:53.270067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:53.272345 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:53.272828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:53.273254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:53.273967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:53.274422 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:53.274852 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:53.276326 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:53.276876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:53.277373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:53.278162 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:53.279291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:53.279291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:53.295393 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 HTTP/1.1 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:22:53.297402 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:22:53.299168 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '39ad4a4c-7d17-429f-a99a-50572de3a588'} Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:53.300125 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:22:53.302563 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:22:53.303667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:53.303667 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3c881763-332c-43c5-80a4-1658e9bbf469 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 404 len: 111 microversion: 2.20 time: 0.038100 Aug 07 01:22:53.303667 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 343/711] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:53 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:22:53.310944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-93fd0707-d577-40a7-9139-c166504b7090 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '.version_select at 0x7fb7d0d148b0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:53.417962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:53.425906 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-93fd0707-d577-40a7-9139-c166504b7090 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687312122" status: 204 len: 0 microversion: 2.20 time: 0.119213 Aug 07 01:22:53.426112 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-633b2067-96a2-4334-bff7-215325574fd6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.161113 Aug 07 01:22:53.426494 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 344/712] 10.222.0.36 () {60 vars in 1259 bytes} [Sun Aug 7 01:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687312122 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:22:53.426967 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 369/713] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:53 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:54.288186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9b858995-21d2-47a5-906f-a5221bb9fb35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: .version_select at 0x7fb7d0d21820>, body: {"keypair": {"name": "tempest-keypair-665357237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1A5YPhf/WLCrtKnnX+GWvVf7Qc0KnstNPFXB7gVxCQ/YhrVqHmVvLf+BJWp+HKGWMbXM4EslgYRGTgd00ox1C+9dJhiLkTQZd9V5VLbNWyWHP1+rDRKEYbeJqOdE2l6w=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:54.305505 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-9b858995-21d2-47a5-906f-a5221bb9fb35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for project 6785d30930ee41d88a31ff0760f8d699. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:54.309310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-9b858995-21d2-47a5-906f-a5221bb9fb35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for user 598402f6609c422cbcc0dd0bfae53430 and project 6785d30930ee41d88a31ff0760f8d699. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:54.420771 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9b858995-21d2-47a5-906f-a5221bb9fb35 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.137074 Aug 07 01:22:54.421382 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 345/714] 10.222.0.36 () {62 vars in 1200 bytes} [Sun Aug 7 01:22:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:22:54.447581 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:54.450889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:54.455057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.455545 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.456229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:54.456924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.457378 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.457851 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:54.476810 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:54.591553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:54.599687 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-75bf6e16-acf3-42ba-8efd-2d21558591b0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.156022 Aug 07 01:22:54.603238 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 370/715] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:54 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:55.621879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:55.622439 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:55.628481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:55.628961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:55.629394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:55.630104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:55.630560 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:55.630986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:55.830576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:55.838863 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-329e80f4-e5c4-400b-b416-f5d8e3d0bc42 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.221544 Aug 07 01:22:55.839685 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 346/716] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:55 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:56.863422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:56.864854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:56.872532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:56.874102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:56.874894 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:56.875818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:56.876507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:56.877227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.023694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:57.032735 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa5218e1-5163-4bed-9e41-5aea49afd1d5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.175896 Aug 07 01:22:57.033921 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 371/717] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:56 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:57.273200 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1369051687", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c03bb01c-9570-4dec-aa6b-e3790ed83c98"}], "security_groups": [{"name": "tempest-securitygroup--1559002547"}], "key_name": "tempest-keypair-665357237", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:57.384637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] validate_networks() for [('c03bb01c-9570-4dec-aa6b-e3790ed83c98', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:57.814325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:57.814748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:57.815272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:57.815731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:57.816140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:57.824828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.825301 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.825728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.827057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.827508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.827929 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.844645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for project 6785d30930ee41d88a31ff0760f8d699. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:57.848760 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Getting quotas for user 598402f6609c422cbcc0dd0bfae53430 and project 6785d30930ee41d88a31ff0760f8d699. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:57.859825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:57.862090 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:57.994545 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0ac13636-d772-43b7-b496-dffa1972884b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.725631 Aug 07 01:22:57.995179 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 347/718] 10.222.0.36 () {62 vars in 1188 bytes} [Sun Aug 7 01:22:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:22:58.006988 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:58.007747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:58.056947 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:58.058347 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:58.063109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:58.065983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:58.071648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:58.071648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:58.071648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:58.071648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:58.071996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:58.073933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:58.076028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:58.078461 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-efd81782-009f-4477-b18c-636362b64523 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1281 microversion: 2.20 time: 0.075305 Aug 07 01:22:58.079015 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 372/719] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:58 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:58.207078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:58.216344 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f3c0ffdd-5f88-4203-9de4-d1ed3e8ec061 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1734 microversion: 2.1 time: 0.163661 Aug 07 01:22:58.217172 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 348/720] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:58 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:59.100745 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:59.101377 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.107310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.108705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.108705 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.109004 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.109450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.109896 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.171676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.179956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.181457 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.182597 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0d42e76d-e204-4c98-8294-019e3f657594 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1285 microversion: 2.20 time: 0.085901 Aug 07 01:22:59.183206 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 373/721] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:59 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:59.237285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:59.237921 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.244358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.244835 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.245265 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.245981 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.246431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.246853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.377576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.385577 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-07983c9d-6daa-4a43-a3a9-d4a0ab035fd0 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1714 microversion: 2.1 time: 0.152076 Aug 07 01:22:59.386188 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 349/722] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:59 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:59.492257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:59.492765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.499251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.499875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.500313 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.501022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.501476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.501932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.589061 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] HTTP exception thrown: Cannot 'detach_volume' instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d while it is in vm_state rescued Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Request method failure captured: Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments/38b51bdb-4e5a-41c4-be92-94cc05e4e256 HTTP/1.1 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xLvNd-I3isnSu5qim6ZtzAjVLP5O9slOoH1qEh5k2fvFMuy_FbNh_b0E2ZtIQ6WGkvzEpj-XCdoxYTqVmxQgbAoXCs8ZNgcwxS4HeYneRzvMQ2nmjZ9qy0txnsPOYfYeX6t4673mi6CpUlEH58e_hbD8b0xQ3nTJ_jPkVRgofsRNOA Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:22:59.591110 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32cc230c70b341fca95fa1b962d73909", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 75266a74abbb4129bac206a7d5944466 Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:22:59.592788 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Cannot 'detach_volume' instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d while it is in vm_state rescued Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'server_id': 'e547fd5a-12b9-446a-8686-17d8c2cf3a2d', 'id': '38b51bdb-4e5a-41c4-be92-94cc05e4e256'} Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:59.593602 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d while it is in vm_state rescued Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d while it is in vm_state rescued Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:22:59.595239 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Returning 409 to user: Cannot 'detach_volume' instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d while it is in vm_state rescued {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:59.596383 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3ab18aa2-5463-4466-9d0b-83bd7203f2b3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments/38b51bdb-4e5a-41c4-be92-94cc05e4e256" status: 409 len: 152 microversion: 2.1 time: 0.105175 Aug 07 01:22:59.596383 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 374/723] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:22:59 2022] DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments/38b51bdb-4e5a-41c4-be92-94cc05e4e256 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:22:59.602714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:59.603246 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.609692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.610213 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.610647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.611334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.611792 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.612210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.659399 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:00.006155 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-63feae30-0e87-4cbc-bc5a-5022d35dcf67 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/action" status: 202 len: 0 microversion: 2.1 time: 0.406989 Aug 07 01:23:00.006890 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 350/724] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:59 2022] POST /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:00.015159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:00.015811 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:00.021754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.022270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.022703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.023393 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.023844 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.024265 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.155964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:00.164135 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ae63add3-7011-42cb-b3d3-e99919284979 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1722 microversion: 2.1 time: 0.152852 Aug 07 01:23:00.164706 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 375/725] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:00 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:00.205513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:00.206497 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:00.213011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.213489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.213939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.214617 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.215062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.215476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.283111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:00.291255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:00.292750 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:00.293859 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e4bdfdc2-0a9d-42a9-a611-eb5368881f0d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1333 microversion: 2.20 time: 0.092818 Aug 07 01:23:00.294407 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 351/726] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:00 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:01.187197 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:01.189074 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:01.195335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.198096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.198096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.198096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.198096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.198605 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.317585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:01.318978 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:01.328483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.332562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.338300 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.338738 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.339637 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.340091 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.340514 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.344761 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a2a18282-993d-4abf-b01c-04a669df7789 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1722 microversion: 2.1 time: 0.155269 Aug 07 01:23:01.345898 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 376/727] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:01 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:01.419811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.428413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.429919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.431070 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-794d6364-00cf-4476-920b-a60c3d87af55 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1339 microversion: 2.20 time: 0.117656 Aug 07 01:23:01.431615 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 352/728] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:01 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:02.366353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:02.366995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:02.372901 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.373958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.374500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.375180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.375629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.376044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.455644 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:02.456496 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:02.463133 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.464634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.464634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.464885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.465333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.465748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.505150 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.513250 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4d64ed38-1355-4155-ac9b-91d9311b698d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1722 microversion: 2.1 time: 0.150703 Aug 07 01:23:02.514449 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 377/729] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:02 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:02.602106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.610636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.612135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.613233 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f9486f55-0889-4580-bd9c-141bfb0b5e39 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.162200 Aug 07 01:23:02.613815 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 353/730] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:02 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:03.535797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:03.536398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:03.542405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.543013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.543443 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.544127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.544658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.545143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.637435 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:03.638263 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:03.646194 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.646842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.647376 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.648180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.648740 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.649268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.683450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.692323 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-12c32bc5-aa76-44ba-bb2e-9b7545f2626e tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1722 microversion: 2.1 time: 0.160431 Aug 07 01:23:03.693478 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 378/731] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:03 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:03.926773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.931100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.932641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.933777 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f05b605b-e4ba-4cd3-9b82-55b8fdaf6eb3 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.301248 Aug 07 01:23:03.934359 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 354/732] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:03 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:04.316029 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:04.325977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.327326 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.327897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.339946 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] Creating event network-changed:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:23:04.345736 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-ba161d36-8f2e-46bb-9ad8-6ba1d257ae08 req-546f3e2f-b8b5-4216-8316-58e54213dea7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037819 Aug 07 01:23:04.346374 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 379/733] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:04.714606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:04.715264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:04.722175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.722658 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.723084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.723775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.724225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.724645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.958630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:04.959363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:04.965501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.966033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.966464 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.967778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.968232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.968661 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.981098 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:04.990060 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4e724d02-82cb-4b1e-a032-c0ad357bdc1b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1728 microversion: 2.1 time: 0.279144 Aug 07 01:23:04.990834 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 355/734] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:04 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1728 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:05.010509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:05.011005 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:05.017691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.018221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.018654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.019358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.019806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.020227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.111216 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.120558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.123356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.123985 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0d25f0c8-b8e4-4de0-8e13-973a4765d300 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.169407 Aug 07 01:23:05.125600 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 380/735] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:04 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:05.143000 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3e0d6e7b-58e2-4a5c-b250-0e183cd37cac tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136241 Aug 07 01:23:05.143885 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 356/736] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:05 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:23:06.146992 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:06.147638 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:06.153476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.153982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.154442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.155131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.155788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.156198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.163480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:06.172915 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.173391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.173867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.184859 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] Creating event network-changed:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:23:06.190446 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-8bca6265-84f5-493f-ba02-9da49bf856e2 req-2f7f6d56-caeb-4318-8307-f40f02f1faea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089421 Aug 07 01:23:06.191174 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 381/737] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:06.292849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:06.301641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:06.303176 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:06.304283 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7b69176a-a4bf-4f8c-b445-57d222fc8a05 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.162271 Aug 07 01:23:06.317953 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 357/738] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:06 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:07.327625 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:07.328316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:07.334725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.335215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.335650 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:07.336350 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.336816 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.337244 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:07.472318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.480321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.481889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.483654 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8cbcd8c2-4b8d-4f5f-be27-9a9ba2ab831b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.160295 Aug 07 01:23:07.484221 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 382/739] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:07 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:08.204692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:08.210229 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:08.210994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=10 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:08.215951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:08.216569 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:08.217499 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:08.230264 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] Creating event network-changed:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:23:08.236295 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-436a4708-d1b3-4d1d-99be-6aea9884594b req-32322292-fcfc-4423-852b-6e4ae44dda69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035284 Aug 07 01:23:08.236874 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 358/740] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:08.506463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:08.506997 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:08.508945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:08.513761 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:08.519541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:08.519541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:08.519541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:08.519541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:08.519875 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:08.650287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:08.659530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:08.661036 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:08.662189 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0c138340-640f-4359-8a86-1cf22e035083 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.160017 Aug 07 01:23:08.662759 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 383/741] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:08 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:09.685577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:09.686979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:09.689199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:09.694307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:09.694786 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:09.695245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:09.695931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:09.696378 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:09.696793 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:09.902644 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:09.911998 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:09.914290 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:09.915609 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fef0f047-9cbd-4a3f-8939-f97b6e7dd7b9 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.234828 Aug 07 01:23:09.916181 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 359/742] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:09 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:10.940173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:10.940774 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:10.946970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:10.947456 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:10.947928 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:10.948674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:10.949152 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:10.949580 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:11.077151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.085640 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.087169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.088275 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-632c1053-126c-4ac3-a82e-7f00a6a104dd tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.152775 Aug 07 01:23:11.088845 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 384/743] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:10 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:11.399005 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "name": "network-vif-plugged", "status": "completed", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:11.409227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:11.409774 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:11.410226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:11.421511 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] Creating event network-vif-plugged:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:23:11.426472 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-5168ce87-3221-4273-a85c-f799196daa8d req-6f14747b-1c2a-4611-8bc9-50203110e1eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085365 Aug 07 01:23:11.436422 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 360/744] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:23:12.111132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:12.111738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:12.117684 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.118178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.118612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.119295 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.119744 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.120165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.249857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:12.257809 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:12.259391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:12.260489 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-00837c25-8835-466d-a9f2-493c973baab6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.153500 Aug 07 01:23:12.261035 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 385/745] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:12 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:13.284954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:13.285648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:13.291782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.292264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.292699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.293381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.293851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.294276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.424535 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.432716 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.434260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.439221 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-58c9341e-717b-4391-8f1f-69e4df211b41 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.155827 Aug 07 01:23:13.439221 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 361/746] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:13 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:14.458261 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:14.458895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:14.460783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:14.465389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:14.465892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:14.466324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:14.467505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:14.468035 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:14.468453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:14.596658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:14.604841 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:14.606392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:14.607733 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b530a697-ed74-4da3-be4a-9420ec49458e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1407 microversion: 2.20 time: 0.153496 Aug 07 01:23:14.608291 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 386/747] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:14 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:15.629630 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:15.630254 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:15.636922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.637397 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.637847 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.638531 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.638979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.639395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.771703 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.780216 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.781725 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.783137 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-23fa3bcc-4099-434b-8923-877563dd348e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1600 microversion: 2.20 time: 0.157255 Aug 07 01:23:15.783701 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 362/748] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:15 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:15.805944 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:15.806458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:15.812638 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.813116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.813545 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.814257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.814709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.815134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.842385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-320455565"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:15.842943 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:15.848946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.849420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.849867 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.850556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.850997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.851414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.895776 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5b7bde16-97bf-40cd-879a-c2f8371fe348 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094101 Aug 07 01:23:15.896367 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 387/749] 10.222.0.36 () {60 vars in 1316 bytes} [Sun Aug 7 01:23:15 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:23:15.979237 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.network.security_group_api [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Removing security group 6fb2dabc-1e0f-4cc6-bed2-9ab6b187c52b from port 19f6d674-73ae-4569-8dff-d24ceabf6608 Aug 07 01:23:16.340089 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:16.340638 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:16.347112 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.347592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.348019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.352189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.352189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.352189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.371410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lazy-loading 'flavor' on Instance uuid 0077940a-b8fc-4938-b60e-caa9ea2e20f3 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:23:16.398445 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4f2a77f0-ec67-4c46-9291-de95d4efc684 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action" status: 202 len: 0 microversion: 2.1 time: 0.559882 Aug 07 01:23:16.398721 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 363/750] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:15 2022] POST /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:23:16.407024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:16.417576 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.418211 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.418874 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.430861 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] Creating event network-changed:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:23:16.436401 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-c4ef79a4-806a-4648-8d70-da2560783f8a req-51d7d97c-e65f-4580-a7ff-f590583e1bc1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033878 Aug 07 01:23:16.437011 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 364/751] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:16.578171 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:16.769777 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8b6f66a8-6b04-48f2-9b7d-bbca933e3f89 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "POST /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3/action" status: 202 len: 0 microversion: 2.1 time: 0.432040 Aug 07 01:23:16.770761 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 388/752] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:16 2022] POST /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:23:16.781804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:16.783257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:16.790189 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.790976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.791642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.792540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.793200 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.793904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:17.032150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:17.039805 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d0cd455a-56f7-4644-987b-f56cb93c5358 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.262925 Aug 07 01:23:17.040593 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 365/753] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:16 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:17.272808 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:17.283141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:17.283614 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:17.284038 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:17.295942 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] Creating event network-changed:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:23:17.314458 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-0e341f30-729b-4520-a030-d634404b5f04 req-09626619-566e-42f0-bde1-64f853a739fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Aug 07 01:23:17.315067 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 389/754] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:18.063078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:18.063708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:18.070381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.070872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.071309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.072026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.072480 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.073035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.387967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:18.397261 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-17c289eb-29b5-4cae-9af3-21168af3e3bc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.339009 Aug 07 01:23:18.409380 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 366/755] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:18 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:18.635372 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:18.636177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:18.636602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:18.644141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.644626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.645059 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.645986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.646606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.647186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.648272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.648968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.649753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.662833 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] Creating event network-changed:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:23:18.668135 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-ae94484e-f862-415e-843d-a29871278325 req-a7247545-a883-4557-b291-1540e6d40dce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035534 Aug 07 01:23:18.669244 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 367/756] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:18.732106 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lazy-loading 'services' on Instance uuid d8b8a000-d135-4a84-b9a2-c7f395de5e66 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:23:19.022879 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e37440fd-cd4a-4203-a901-de8da6d82675 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments/5662a3a8-523d-472d-94c0-3e3530f9db6a" status: 202 len: 0 microversion: 2.1 time: 0.391798 Aug 07 01:23:19.023894 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 390/757] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:23:18 2022] DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments/5662a3a8-523d-472d-94c0-3e3530f9db6a => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:19.034460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:19.037036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:19.043565 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.044051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.044491 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.045222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.045667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.046338 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.077547 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b68f130a-4e2d-4cab-a0d9-180c5d5fa289 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048935 Aug 07 01:23:19.078461 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 368/758] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:23:19 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:19.420379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:19.421223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:19.427771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.428261 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.428892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.429677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.430282 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.430794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.567714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:19.575511 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ec3b2308-d6d1-4228-a926-42b767d71295 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.160230 Aug 07 01:23:19.576317 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 391/759] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:19 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:20.090321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:20.093018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:20.099416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.104655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.104655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.104655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.104655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.105060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.131763 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d854e3ca-8896-4337-a4e6-738439cee1b2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Aug 07 01:23:20.132315 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 369/760] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:23:20 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:20.596480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:20.597201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:20.603060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.603532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.603969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.604633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.605079 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.605492 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.735850 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:20.743253 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0c5fa3fd-e603-45c6-a48f-c205f31ad3dc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.150606 Aug 07 01:23:20.743841 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 392/761] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:20 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:21.144126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:21.146245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:21.152574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.153018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.153476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.154783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.155409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.155843 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.172935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:21.184302 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-95b3b30a-3070-49f8-8cfb-4654c79cb9f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044280 Aug 07 01:23:21.184843 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 370/762] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:23:21 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:23:21.195219 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:21.195731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:21.201747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.202254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.202683 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.203358 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.203802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.204219 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.277797 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] HTTP exception thrown: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 is not attached to volume 5662a3a8-523d-472d-94c0-3e3530f9db6a Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Request method failure captured: Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments/5662a3a8-523d-472d-94c0-3e3530f9db6a HTTP/1.1 Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xL_JqRLtDOHz7G-5KqYVO_BWWhulQzz7F--agZykaFoD3bEH6xqc_oUb6X_x_5z4rW16MjXmH6ovxlTNOyETQdz5O4ypjtYY7ycWXrO8bUGCnNAK2mioZDY3GyRsPt34OQOTFKdNTC5x78tBHcc_e-X7VaHAt6_qJywGNi8DOEXDqY Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: da141dca2d874d4bbb679cde1a089b7a Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:23:21.295620 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da141dca2d874d4bbb679cde1a089b7a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: da141dca2d874d4bbb679cde1a089b7a Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-TestMinimumBasicScenario-497269177-project Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b278dc86c8bb4ee5abd24074c8450189 Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-TestMinimumBasicScenario-497269177-project Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:23:21.297307 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 is not attached to volume 5662a3a8-523d-472d-94c0-3e3530f9db6a Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'server_id': 'd8b8a000-d135-4a84-b9a2-c7f395de5e66', 'id': '5662a3a8-523d-472d-94c0-3e3530f9db6a'} Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5662a3a8-523d-472d-94c0-3e3530f9db6a. Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:21.298449 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 is not attached to volume 5662a3a8-523d-472d-94c0-3e3530f9db6a Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 is not attached to volume 5662a3a8-523d-472d-94c0-3e3530f9db6a Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:23:21.300259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Returning 404 to user: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 is not attached to volume 5662a3a8-523d-472d-94c0-3e3530f9db6a {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:21.301463 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-157b7338-248d-47ed-bc96-c560e596058f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments/5662a3a8-523d-472d-94c0-3e3530f9db6a" status: 404 len: 154 microversion: 2.1 time: 0.105983 Aug 07 01:23:21.301463 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 393/763] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:23:21 2022] DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66/os-volume_attachments/5662a3a8-523d-472d-94c0-3e3530f9db6a => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:21.764812 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:21.765419 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:21.772111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.772594 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.773026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.773726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.774226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.774655 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.906000 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:21.913467 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6bcc84eb-2a6e-44fa-afb5-9812bcbb2912 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.153112 Aug 07 01:23:21.914055 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 371/764] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:21 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:22.624208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.624702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:22.630653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.631127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.631552 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.632224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.632667 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.633081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.657485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:22.934859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.936105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:22.942437 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.947628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.947628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.947628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.947628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.948062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.082711 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bdde504c-6138-4868-9aba-73113fe61173 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 204 len: 0 microversion: 2.1 time: 0.462305 Aug 07 01:23:23.083405 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 394/765] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:22 2022] DELETE /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:23.085737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.091889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:23.092634 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:23.094374 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99c1a59c-6545-4102-845d-891b10c28bd4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.163245 Aug 07 01:23:23.095212 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 372/766] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:22 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:23.102093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.102619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.106642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.106642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.106642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.106642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.233598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.241012 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f9da578c-5a06-4da5-83bf-baa50352619f tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1553 microversion: 2.1 time: 0.153282 Aug 07 01:23:23.241580 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 395/767] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:23 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:24.117377 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:24.118035 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:24.124999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.125474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.125935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.126616 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.127062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.127477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.254895 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:24.261853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:24.262347 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e3f533f3-57e5-4c32-ba6d-dd493e7e5a82 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.148777 Aug 07 01:23:24.262606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:24.262903 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 373/768] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:24 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:24.269529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.270049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.270483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.271170 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.271624 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.272044 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.399027 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:24.406803 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-93bba73e-8ae8-4b21-bfa6-648a65cda1f2 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1553 microversion: 2.1 time: 0.148729 Aug 07 01:23:24.407368 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 396/769] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:24 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:25.284075 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.284751 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:25.291093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.291569 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.292002 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.292678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.293123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.293539 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.428567 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.429169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:25.435294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.435781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.436210 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.436912 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.437356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.437780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.573118 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.581907 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-461941c1-eb22-46d6-a8fb-8631f45be78b tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1553 microversion: 2.1 time: 0.157101 Aug 07 01:23:25.582859 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 397/770] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:25 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:25.721388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.729021 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bb239fee-dc55-4f91-a858-c0a0012521af tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.449730 Aug 07 01:23:25.729591 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 374/771] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:25 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:26.202200 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b8a000-d135-4a84-b9a2-c7f395de5e66", "name": "network-vif-deleted", "tag": "19f6d674-73ae-4569-8dff-d24ceabf6608"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:26.212302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.225215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.225215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.225215 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] Creating event network-vif-deleted:19f6d674-73ae-4569-8dff-d24ceabf6608 for instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 on hv-cinder-maste Aug 07 01:23:26.230312 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-864fd1b4-1a78-49aa-88ee-5df5c70c9488 req-936c90de-90b2-413a-92fd-dd499a9ec79c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Aug 07 01:23:26.230988 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 398/772] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:26.607027 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:26.607027 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:26.610877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.611381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.611820 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.612515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.613026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.613500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.646088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.646606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.647060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.647654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lazy-loading 'fault' on Instance uuid d8b8a000-d135-4a84-b9a2-c7f395de5e66 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:23:26.691574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b278dc86c8bb4ee5abd24074c8450189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da141dca2d874d4bbb679cde1a089b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:26.699206 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0170906c-0c8b-4259-ad41-0d471cb7459c tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 200 len: 1347 microversion: 2.1 time: 0.099928 Aug 07 01:23:26.699774 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 375/773] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:26 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:26.750661 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:26.754678 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:26.758311 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.758792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.759226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.759908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:26.760410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:26.760835 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.892675 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:26.900235 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-83602532-d1b9-49e9-bad1-da44f514180b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.153826 Aug 07 01:23:26.900799 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 399/774] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:26 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:27.723647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:27.724184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] [instance: d8b8a000-d135-4a84-b9a2-c7f395de5e66] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:27.732972 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.733540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.734018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:27.734715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.735163 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.735615 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:27.749324 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] HTTP exception thrown: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Request method failure captured: Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 HTTP/1.1 Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xL_JqRLtDOHz7G-5KqYVO_BWWhulQzz7F--agZykaFoD3bEH6xqc_oUb6X_x_5z4rW16MjXmH6ovxlTNOyETQdz5O4ypjtYY7ycWXrO8bUGCnNAK2mioZDY3GyRsPt34OQOTFKdNTC5x78tBHcc_e-X7VaHAt6_qJywGNi8DOEXDqY Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: da141dca2d874d4bbb679cde1a089b7a Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:23:27.750975 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da141dca2d874d4bbb679cde1a089b7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da141dca2d874d4bbb679cde1a089b7a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: da141dca2d874d4bbb679cde1a089b7a Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-TestMinimumBasicScenario-497269177 Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-TestMinimumBasicScenario-497269177-project Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b278dc86c8bb4ee5abd24074c8450189 Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-TestMinimumBasicScenario-497269177-project Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. Aug 07 01:23:27.752377 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'd8b8a000-d135-4a84-b9a2-c7f395de5e66'} Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:27.753138 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. Aug 07 01:23:27.754352 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:27.755427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Returning 404 to user: Instance d8b8a000-d135-4a84-b9a2-c7f395de5e66 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:27.755427 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c3a2d9cc-cf76-481a-9815-23e7365b243e tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66" status: 404 len: 111 microversion: 2.1 time: 0.032666 Aug 07 01:23:27.755427 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 376/775] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:27 2022] GET /compute/v2.1/servers/d8b8a000-d135-4a84-b9a2-c7f395de5e66 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:27.760914 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a222b735-bdf9-46a5-9b2e-0d764be006d4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] Calling method '.version_select at 0x7fb7d079f700>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:27.877960 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a222b735-bdf9-46a5-9b2e-0d764be006d4 tempest-TestMinimumBasicScenario-497269177 tempest-TestMinimumBasicScenario-497269177-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-700662783" status: 202 len: 0 microversion: 2.1 time: 0.120660 Aug 07 01:23:27.878532 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 400/776] 10.222.0.36 () {58 vars in 1269 bytes} [Sun Aug 7 01:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-700662783 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:27.923103 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:27.923715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:27.930124 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.930603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.931033 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:27.931775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.932225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.932920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.067999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:28.075570 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5e3e0e0e-dab0-435b-9e08-80db6814be7a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.157330 Aug 07 01:23:28.076653 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 377/777] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:27 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:29.096908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.097521 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.103701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.104181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.104609 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.105293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.105740 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.106187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.246093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.254210 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-40bf3df3-a17d-41ad-9f15-a6541d20456f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.161325 Aug 07 01:23:29.254797 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 401/778] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:30.282579 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:30.283201 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:30.289607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:30.290153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:30.290836 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:30.291710 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:30.292168 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:30.292591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:30.515744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:30.523444 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5eddc107-b5ab-4149-be59-96bd6055edb8 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.244655 Aug 07 01:23:30.537533 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 378/779] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:30 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:31.544588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:31.545302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:31.551572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.552167 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.552667 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.553431 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.553987 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.554479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.692100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:31.699888 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a97c6b8f-61c7-462e-b615-2c68a12ecddc tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.159172 Aug 07 01:23:31.700658 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 402/780] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:31 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:32.723328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:32.723911 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:32.730561 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.731109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.731600 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.732394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.733449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.733943 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.027590 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.037746 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0f25cac2-280f-47f4-9553-2ac47fa8f7b1 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.318592 Aug 07 01:23:33.038363 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 379/781] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:32 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:33.487028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.489202 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.496180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.496921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.497520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.499362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.500230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.500835 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.533755 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a813a677-ebb8-4a8d-876f-bbbc2197b54f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050695 Aug 07 01:23:33.534656 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 403/782] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:23:33 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:23:33.601442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.602054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.608772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.609336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.609897 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.610675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.611207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.611739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.636998 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:33.964545 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fe5c34f1-c1d7-4bfe-9611-c9785a0a49c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 204 len: 0 microversion: 2.1 time: 0.366827 Aug 07 01:23:33.965193 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 380/783] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:33 2022] DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:33.978920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.979886 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.987755 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.988241 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.988677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.989376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.989852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.990271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.009368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:34.060127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.060970 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:34.067113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.067604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.068041 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.068727 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.069180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.069605 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.198787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.206151 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.207871 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0897ffcd-5888-47ca-b47e-12588501ed9c tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1675 microversion: 2.1 time: 0.237551 Aug 07 01:23:34.208709 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 404/784] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:33 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:34.214364 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0c6db240-1029-4733-9355-3bfa6791e195 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.158532 Aug 07 01:23:34.215200 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 381/785] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:35.236106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.236773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.243762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.244372 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.248133 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.248615 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.249046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.249798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.250209 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.250629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.251078 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.251573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.252031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.252881 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.253345 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.253772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.399879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.410498 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-178d57fc-9d99-42c3-9d02-968711503771 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.178738 Aug 07 01:23:35.425122 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 382/786] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:35.707799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.715307 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5f4298bc-8dfc-43ae-8f53-b01ea153af5e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1675 microversion: 2.1 time: 0.487050 Aug 07 01:23:35.715875 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 405/787] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1675 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:36.432670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.433333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.440759 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.441250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.441976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.442690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.443142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.443563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.592706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:36.601779 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9daa89a1-eec5-4b22-96d1-b6365906d998 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.173154 Aug 07 01:23:36.602449 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 383/788] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:36.737132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.748979 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.764719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.765444 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.772451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.772451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.773049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.780022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.074046 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.083126 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2bbe9cb8-63f9-4022-b385-1f5bb8472068 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1675 microversion: 2.1 time: 0.350200 Aug 07 01:23:37.084234 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 406/789] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1675 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:37.528885 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:37.548221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.548705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.550396 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.565429 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] Creating event network-vif-unplugged:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:23:37.573519 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e9e9eb89-2121-4652-9b73-fd3fe5fd53da req-f850c887-070b-45fc-bd2b-8a517e28cc24 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048797 Aug 07 01:23:37.574833 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 384/790] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:37.627845 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:37.628783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.635187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.635676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.636184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.637564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.637564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.638018 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.806487 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd406a7d-ec74-4def-981c-72d0d5d609d0", "name": "network-vif-deleted", "tag": "74a6f474-8e6c-4604-83d9-12731ed63e7a"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:37.816996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.821258 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.822012 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.822625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.837033 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] Creating event network-vif-deleted:74a6f474-8e6c-4604-83d9-12731ed63e7a for instance bd406a7d-ec74-4def-981c-72d0d5d609d0 on hv-cinder-maste Aug 07 01:23:37.837361 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a074326a-cea5-4f1a-b8ce-cf03c147491a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1569 microversion: 2.1 time: 0.213031 Aug 07 01:23:37.851664 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 407/791] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:37 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:37.863852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:37.864628 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-8e3065cb-1c2f-46fc-b620-a9ca5a64bfde req-739e0836-acff-426f-8b76-1008ceb2d92a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063336 Aug 07 01:23:37.865330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.865576 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 385/792] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:37.877223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.877734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.878213 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.878932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.879388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.879819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.913468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118310) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:23:38.105568 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.108771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.114988 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.117082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.117644 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.118524 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.119058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.119559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.191674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.199280 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-131c2dc0-e622-4859-90a8-2c0d31704bc5 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 200 len: 1322 microversion: 2.1 time: 0.097895 Aug 07 01:23:38.199844 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 386/793] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:38.412863 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [a73cd4b8-6cfd-4d9c-a45e-bc4317f67a98] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 01:23:39.221319 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.221888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.228395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.228871 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.229299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.230020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.230520 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.230940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.235721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.245097 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 HTTP/1.1 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:23:39.246748 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:23:39.254630 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'bd406a7d-ec74-4def-981c-72d0d5d609d0'} Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:39.255490 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:23:39.256864 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:23:39.258138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:39.258138 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cda3c4e6-9f88-4da0-b8fd-6a6d600f6eb0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 404 len: 111 microversion: 2.1 time: 0.031389 Aug 07 01:23:39.258138 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 387/794] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:23:39.261879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-867fb010-3bbd-49a6-87e0-06e868773637 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '.version_select at 0x7fb7d0d07670>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.421343 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [a73cd4b8-6cfd-4d9c-a45e-bc4317f67a98] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58842. Aug 07 01:23:39.424772 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9f7f4c39-f360-488a-8995-28267d3a0bd2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "POST /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3/action" status: 202 len: 0 microversion: 2.1 time: 1.566739 Aug 07 01:23:39.428429 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 408/795] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:37 2022] POST /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3/action => generated 0 bytes in 1569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:39.433941 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.434355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.444103 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-867fb010-3bbd-49a6-87e0-06e868773637 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754802521" status: 202 len: 0 microversion: 2.1 time: 0.190100 Aug 07 01:23:39.444837 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 388/796] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Aug 7 01:23:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754802521 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:23:39.446891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.447304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.447797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.448556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.449012 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.449432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.686439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:39.693904 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5ec01e5e-0989-46de-acae-839671c97ebb tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1517 microversion: 2.1 time: 0.264226 Aug 07 01:23:39.694476 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 409/797] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:40.380916 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ab182956-6a31-40bd-9ae8-72ba814314cb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: .version_select at 0x7fb7d0c83d30>, body: {"keypair": {"name": "tempest-keypair-1318756901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIll48TX0pahQeWiKN74qLvofUHPDhUqXkpzCc68l2FzK8idHW6xfP94HOGHc2fPtH1m+PD+zX4eO+oJ4KLuqo1B+7Balflg2uAOmjY7eMWcPjIAk3OlRU0Fko/olRbF5Q=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:40.387555 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:40.398938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-ab182956-6a31-40bd-9ae8-72ba814314cb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for project 440652d4d24d4a34985625be49c12a70. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:40.402860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-ab182956-6a31-40bd-9ae8-72ba814314cb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for user 4c8389683e844b989fe5cbe779327933 and project 440652d4d24d4a34985625be49c12a70. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:40.502791 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ab182956-6a31-40bd-9ae8-72ba814314cb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126103 Aug 07 01:23:40.503391 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 389/798] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:23:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:40.715608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:40.716305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:40.722298 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.722779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.723212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.723900 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.724356 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.724781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.858642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.866043 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-84d0dffc-eba0-4272-9f4d-83a5a106a156 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1517 microversion: 2.1 time: 0.154293 Aug 07 01:23:40.866599 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 410/799] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:40 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:41.888351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.890468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.898679 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.899459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.900055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.900895 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.901514 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.901960 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.092829 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:42.100481 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-990c5c2f-9ba7-4f02-a439-e50505c5de8b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1517 microversion: 2.1 time: 0.216426 Aug 07 01:23:42.101045 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 390/800] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:43.086415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1740042271", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7412368-3b33-4779-8fa8-86d88886c06e"}], "security_groups": [{"name": "tempest-securitygroup--1147700852"}], "key_name": "tempest-keypair-1318756901", "user_data": "}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:43.121729 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:43.122383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:43.130768 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.131124 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.131566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.132270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.134613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.137863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.198707 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] validate_networks() for [('d7412368-3b33-4779-8fa8-86d88886c06e', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:23:43.276978 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.284785 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-412773be-a73b-403f-a1b1-12d91b6b82f2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1517 microversion: 2.1 time: 0.167503 Aug 07 01:23:43.285353 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 391/801] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:43 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:43.652383 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:23:43.652806 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:23:43.653280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:23:43.653716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:23:43.654154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:23:43.663752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.664235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.664668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.665414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.665868 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.666298 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.683225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for project 440652d4d24d4a34985625be49c12a70. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:43.687154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Getting quotas for user 4c8389683e844b989fe5cbe779327933 and project 440652d4d24d4a34985625be49c12a70. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:43.697897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:23:43.700177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:23:43.868286 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-097d4bae-224b-4126-85be-0258f2e4fbec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786466 Aug 07 01:23:43.868933 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 411/802] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:23:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:23:43.879654 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-887f6632-7892-4746-a5a2-011fe2e3455e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:43.880500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-887f6632-7892-4746-a5a2-011fe2e3455e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:43.933414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-887f6632-7892-4746-a5a2-011fe2e3455e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.940646 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-887f6632-7892-4746-a5a2-011fe2e3455e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1238 microversion: 2.1 time: 0.064720 Aug 07 01:23:43.941209 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 392/803] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:43 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:44.306357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.306972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.313531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.314061 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.314495 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.315193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.315690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.316107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.450653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:44.460512 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a4ec6b46-bee6-4dd3-9cb1-30ff889e1e09 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1517 microversion: 2.1 time: 0.158345 Aug 07 01:23:44.461556 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 412/804] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:44.961114 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.961772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.968652 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.969129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.969559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.970270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.970714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.971127 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.036454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.043999 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1db3f1ff-85cd-4e6b-b487-24a36c3f2a76 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1242 microversion: 2.1 time: 0.087161 Aug 07 01:23:45.044566 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 393/805] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:45.596717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:45.597331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:45.603371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.603857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.604293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.605010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.605440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.605954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.738104 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.745724 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b1e47e87-517e-48b7-a6b8-552c25fbe91d tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1519 microversion: 2.1 time: 0.266944 Aug 07 01:23:45.746349 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 413/806] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:45 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:46.065239 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.065881 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:46.072443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.072931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.073931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.074097 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.074573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.075001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.167113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.175048 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-87ceb8ab-e1e5-46df-aa1e-668cf4b1c994 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1298 microversion: 2.1 time: 0.114126 Aug 07 01:23:46.175809 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 394/807] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:46 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:46.767907 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.769124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:46.771075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:46.776625 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.777367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.777799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.778619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.779128 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.779550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.916157 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.924983 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6912db92-8371-48d0-ae10-276350e2247c tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.161723 Aug 07 01:23:46.925605 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 414/808] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:46 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:47.202154 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:47.203185 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:47.210327 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.210979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.211520 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.212430 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.213015 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.213551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.766415 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.773879 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c945b9a0-e78e-45c0-bf20-8573170044fb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.575704 Aug 07 01:23:47.774452 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 395/809] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:47 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:47.946528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:47.947205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:47.954329 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.954818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.955252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.955944 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.956399 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.956822 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.094067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.100610 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f3230f0d-16a4-47ae-b678-39e91e03bc59 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.158344 Aug 07 01:23:48.101191 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 415/810] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:47 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:48.586697 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c64516-610b-455f-92db-0dfdcb1144bb", "tag": "50cbbb01-1828-4dd4-9eb3-dc7a2102256d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:48.597570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.598078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.598505 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.609157 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] Creating event network-changed:50cbbb01-1828-4dd4-9eb3-dc7a2102256d for instance e7c64516-610b-455f-92db-0dfdcb1144bb on hv-cinder-maste Aug 07 01:23:48.614130 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-a860cd40-5622-4c0c-b279-1d11862bd9e3 req-c7fb303b-9ef5-45d7-ab26-a6bd323a6bab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031279 Aug 07 01:23:48.614730 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 396/811] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:48.795642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.796369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:48.802272 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.802755 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.803186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.803867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.804317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.804736 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.934618 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.942459 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a050c4ac-1406-4900-b80b-0c38fec97f66 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.150719 Aug 07 01:23:48.943029 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 416/812] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:48 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:49.122472 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.123171 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:49.129950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.130434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.130897 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.131583 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.132041 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.132463 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.265410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:49.272981 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2dde1656-c5f0-4298-98f7-4f494a22ba75 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.154791 Aug 07 01:23:49.273553 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 397/813] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:49 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:49.963192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.963728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:49.969737 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.970245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.970677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.971361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.971814 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.972238 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.098414 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.105968 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4af5e212-1ce1-43f0-a737-98cec11ea6b7 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.146614 Aug 07 01:23:50.106430 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 417/814] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:49 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:50.294165 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:50.294704 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:50.301883 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.302367 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.302800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.303482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.303934 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.304355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.433046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.440584 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-51d40d3c-d768-46d0-b98b-2714ddaf7973 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.150349 Aug 07 01:23:50.441244 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 398/815] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:50 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:51.127878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.128467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:51.134335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.134817 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.135246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.135930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.136375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.136797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.268891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.276546 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b3738c28-1607-4025-af8d-a24820492fca tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.153150 Aug 07 01:23:51.277115 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 418/816] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:51 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:51.462351 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.463058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:51.470431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.471157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.471818 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.472713 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.473538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.473653 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.615387 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.622984 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a435ac3d-7016-46bd-b576-721d8ae4c7e4 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.165011 Aug 07 01:23:51.623550 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 399/817] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:51 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:52.297588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.298221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.304224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.304754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.305179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.305886 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.306347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.306782 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.437416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:52.445586 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-54819f80-5d8b-4097-b8cd-0d95b248308f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.152054 Aug 07 01:23:52.446198 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 419/818] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:52.645345 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.646013 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.652343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.652817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.653244 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.653948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.654394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.654811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.787675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:52.795162 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9dc11f1c-915b-4876-bf17-c555e164fd0b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.154428 Aug 07 01:23:52.795919 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 400/819] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:53.466830 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:53.467446 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:53.474263 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.474750 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.475192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.475902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.476366 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.476785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.603619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:53.607053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:53.611397 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f75d5719-a58d-4e0d-bb98-e03ce2122cd4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.148632 Aug 07 01:23:53.611968 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 420/820] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:53 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:53.798221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:53.808214 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.811333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.811333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.818209 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:53.818857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:53.821707 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:53.822389 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=6 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:53.824814 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] Creating event network-vif-plugged:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:23:53.826525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.827015 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.827451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.828638 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.829099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.829518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.830529 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-9d13aa0b-c25a-477a-903b-58b7e8cc41e9 req-b96aeecb-5c35-4198-9cd3-64bcc455d687 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036501 Aug 07 01:23:53.831128 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 401/821] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:53.964894 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:53.972728 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d2b8a9f6-a7d4-4149-84a4-4910b49462c5 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.158872 Aug 07 01:23:53.977574 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 421/822] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:53 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:54.632857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:54.633546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:54.635522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:54.640454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:54.640932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:54.641362 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.642073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:54.642522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:54.642946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.771863 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:54.779352 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9363fa50-f5f5-4fec-9886-4720cdac8f3b tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.150780 Aug 07 01:23:54.783328 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 402/823] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:54 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:54.993995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:54.994606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:55.001382 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.001883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.002321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:55.003002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.003460 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.003883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:55.132728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:55.140379 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-cd7238c8-3264-41ea-9215-33fe083c1f6f tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.150302 Aug 07 01:23:55.141503 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 422/824] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:54 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:55.801278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:55.801938 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:55.808273 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.808761 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.809513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:55.810184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.810719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.811072 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:55.949249 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:55.958261 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1f5c010a-571d-4769-9a26-b871df74fffb tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.161301 Aug 07 01:23:55.963146 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 403/825] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:55 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:56.162140 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:56.162682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:56.169000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:56.169485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:56.169951 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:56.170641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:56.171093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:56.171518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:56.303475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:56.310945 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ac561263-40a7-4088-89ef-88bdab38316b tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1575 microversion: 2.1 time: 0.152884 Aug 07 01:23:56.311517 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 423/826] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:56 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:56.980150 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:56.980557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:56.987076 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:56.998080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:56.998080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:56.998080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:56.998080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:56.998465 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.116857 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:57.124235 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47165228-3f19-4a39-b218-57b6a76b10c0 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.148439 Aug 07 01:23:57.124800 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 404/827] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:56 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:57.332038 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:57.332605 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:57.339051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.339537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.339969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.340660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.341111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.341532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.469764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:57.477266 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-59b9f74f-cdfc-49cb-853e-0d80edeb6545 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1562 microversion: 2.1 time: 0.149264 Aug 07 01:23:57.477846 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 424/828] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:57 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:57.900937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c64516-610b-455f-92db-0dfdcb1144bb", "name": "network-vif-plugged", "status": "completed", "tag": "50cbbb01-1828-4dd4-9eb3-dc7a2102256d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:57.911034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.919741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.919741 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.923376 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] Creating event network-vif-plugged:50cbbb01-1828-4dd4-9eb3-dc7a2102256d for instance e7c64516-610b-455f-92db-0dfdcb1144bb on hv-cinder-maste Aug 07 01:23:57.928161 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-4b5b22f9-d88d-4d83-9227-cd01160b6a99 req-4e571b84-5e52-438a-80dd-08b7b56e3eca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Aug 07 01:23:57.928732 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 405/829] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:58.145056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:58.146404 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:58.154487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:58.155001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:58.155435 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:58.156153 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:58.157158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:58.157577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:58.288307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:58.295796 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-38fa27db-c503-4b27-af4e-a58f7f29b5a1 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.155157 Aug 07 01:23:58.296362 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 425/830] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:58 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:59.317554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:59.318286 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:59.324502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:59.324989 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:59.325420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:59.326136 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:59.326591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:59.327017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:59.456743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:59.464440 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2f4d0386-074f-4976-adc9-10fc53190d90 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.151581 Aug 07 01:23:59.467347 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 406/831] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:59 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:00.486292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:00.486895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:00.492842 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.493324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.493794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:00.494505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.494959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.495384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:00.622026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:00.630234 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-15116613-a469-414e-a112-0cf6144b421e tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1364 microversion: 2.1 time: 0.148369 Aug 07 01:24:00.630819 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 426/832] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:00 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:01.651322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:01.651959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:01.658242 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.658726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.659164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.659845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.660299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.660720 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.789099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:01.796553 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1e46c108-d9b2-43a2-961d-b25347b724c9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1550 microversion: 2.1 time: 0.149090 Aug 07 01:24:01.797728 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 407/833] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:01 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:01.818136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:01.818648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:01.824541 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.825026 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.825462 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.826178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.826655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.827069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.902680 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8b351f4b-fc9c-41ce-99cb-df8629034c50 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088208 Aug 07 01:24:01.903223 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 427/834] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:24:01 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:02.923696 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c64516-610b-455f-92db-0dfdcb1144bb", "tag": "50cbbb01-1828-4dd4-9eb3-dc7a2102256d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:02.933325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:02.933804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:02.934266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:02.945986 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] Creating event network-changed:50cbbb01-1828-4dd4-9eb3-dc7a2102256d for instance e7c64516-610b-455f-92db-0dfdcb1144bb on hv-cinder-maste Aug 07 01:24:02.951102 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f3c07df1-bfe0-433e-848a-97cd0e9f13a6 req-bc4b1435-939e-465c-a243-3da762ff6966 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030911 Aug 07 01:24:02.951582 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 408/835] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:12.626528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=27 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:12.627281 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=40 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:12.631306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:12.631798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:12.637533 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:12.638058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:12.638497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:12.639186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:12.639642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:12.640071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:12.720307 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'services' on Instance uuid e547fd5a-12b9-446a-8686-17d8c2cf3a2d {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:13.002482 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7ca95ab3-e6bc-4814-99e8-afa05984d611 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments/38b51bdb-4e5a-41c4-be92-94cc05e4e256" status: 202 len: 0 microversion: 2.1 time: 0.377422 Aug 07 01:24:13.003024 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 428/836] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:24:12 2022] DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments/38b51bdb-4e5a-41c4-be92-94cc05e4e256 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:24:13.009183 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:13.014609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=92 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:13.014609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:13.017197 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:13.023579 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:13.024069 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:13.024504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:13.025305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:13.025782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:13.026280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:13.055995 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5a780e8a-7551-4494-93a0-d7ab50a08cbe tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048378 Aug 07 01:24:13.056550 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 409/837] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:24:13 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:14.069967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:14.072280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:14.078648 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:14.079134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:14.079571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:14.080268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:14.080717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:14.081136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:14.111079 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b71ca54b-0065-4dc0-8437-8635f4ae50ce tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Aug 07 01:24:14.111666 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 429/838] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:24:14 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:15.123688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:15.126411 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:15.133516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.138920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.138920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.138920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.138920 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.139285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.165334 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5974e68f-d8e2-4cc3-84a1-510c9b1895b5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045899 Aug 07 01:24:15.165910 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 410/839] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:24:15 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:24:15.243321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:15.243893 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:15.250545 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.251099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.251559 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.252252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.252701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.253125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.278371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:15.604642 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f7bd147c-fa18-49fe-8348-7e50ede9899b tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 204 len: 0 microversion: 2.1 time: 0.364877 Aug 07 01:24:15.605239 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 430/840] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:24:15 2022] DELETE /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:15.614840 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:15.618808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:15.621567 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.622077 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.622507 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.623196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.623628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.624040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.756957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:15.764382 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f5199a7d-cd54-46b1-8dc5-e8f5913507ca tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1688 microversion: 2.1 time: 0.154453 Aug 07 01:24:15.764945 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 411/841] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:15 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:16.785447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:16.786181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:16.792445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:16.792930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:16.793367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:16.794115 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:16.794573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:16.795022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:16.929165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:16.936634 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a7458b96-b48f-478e-8c34-6bb12cdfcda6 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1688 microversion: 2.1 time: 0.155704 Aug 07 01:24:16.937929 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 431/842] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:16 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:17.959256 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:17.959861 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:17.966556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.967068 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.967501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.968255 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.968805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.969251 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:18.096976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:18.104471 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3ea9e75c-364b-4211-9b29-f3691b00b58f tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1688 microversion: 2.1 time: 0.149430 Aug 07 01:24:18.105038 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 412/843] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:17 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:19.125965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:19.133354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:19.133354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:19.133354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:19.133735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:19.134242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:19.134686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:19.135104 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:19.263143 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:19.270523 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6fec487f-594a-48c6-a5c8-a460609ba81d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1688 microversion: 2.1 time: 0.149127 Aug 07 01:24:19.271084 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 432/844] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:19 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:20.291280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:20.292005 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:20.298860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.299179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.299614 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.300307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.300766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.301174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.705161 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:20.713036 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-33ba3e11-3f66-46eb-b3ab-a1fd90db469d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1688 microversion: 2.1 time: 0.425540 Aug 07 01:24:20.713612 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 413/845] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:20 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1688 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:21.023387 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e547fd5a-12b9-446a-8686-17d8c2cf3a2d", "name": "network-vif-deleted", "tag": "db563326-2ef3-4502-98ed-5fef3818f1d7"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:21.033411 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.034016 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.034508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.045451 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] Creating event network-vif-deleted:db563326-2ef3-4502-98ed-5fef3818f1d7 for instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d on hv-cinder-maste Aug 07 01:24:21.051374 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-50bb0076-edc3-405a-b088-de68e8a80238 req-754a2705-d063-4a23-8f79-db5c6f8d4f00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033009 Aug 07 01:24:21.052296 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 433/846] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:21.734862 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:21.735484 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:21.742729 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.743296 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.743804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.744582 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.745115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.745604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.789944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.789944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.789944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.789944 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'fault' on Instance uuid e547fd5a-12b9-446a-8686-17d8c2cf3a2d {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:21.829899 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:21.837919 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-58378e7e-dfdb-43e5-8ba6-d54d4ab0e083 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 200 len: 1334 microversion: 2.1 time: 0.107186 Aug 07 01:24:21.838495 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 414/847] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:21 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:22.859632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:22.860320 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: e547fd5a-12b9-446a-8686-17d8c2cf3a2d] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:22.866424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:22.866899 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:22.867327 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:22.868006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:22.868450 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:22.868865 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:22.881900 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] HTTP exception thrown: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Request method failure captured: Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d HTTP/1.1 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xLvNd-I3isnSu5qim6ZtzAjVLP5O9slOoH1qEh5k2fvFMuy_FbNh_b0E2ZtIQ6WGkvzEpj-XCdoxYTqVmxQgbAoXCs8ZNgcwxS4HeYneRzvMQ2nmjZ9qy0txnsPOYfYeX6t4673mi6CpUlEH58e_hbD8b0xQ3nTJ_jPkVRgofsRNOA Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:24:22.883483 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32cc230c70b341fca95fa1b962d73909", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 75266a74abbb4129bac206a7d5944466 Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. Aug 07 01:24:22.885052 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'e547fd5a-12b9-446a-8686-17d8c2cf3a2d'} Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:22.886053 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. Aug 07 01:24:22.887612 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:22.889208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Returning 404 to user: Instance e547fd5a-12b9-446a-8686-17d8c2cf3a2d could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:22.889208 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f633d1d7-56cf-4187-9572-6f6bab6772c3 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d" status: 404 len: 111 microversion: 2.1 time: 0.029522 Aug 07 01:24:22.889208 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 434/848] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:22 2022] GET /compute/v2.1/servers/e547fd5a-12b9-446a-8686-17d8c2cf3a2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:24:22.894037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-01a1b0f1-907d-4551-888f-bba9556bf7d7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '.version_select at 0x7fb7d0d14d30>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:22.993972 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-01a1b0f1-907d-4551-888f-bba9556bf7d7 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526621246" status: 202 len: 0 microversion: 2.1 time: 0.104163 Aug 07 01:24:23.003860 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 415/849] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Aug 7 01:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526621246 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:24:26.327862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:26.328336 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:26.335249 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.335722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.336153 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.336831 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.337280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.337698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.361540 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:26.776062 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1ad28d6b-8cc4-4120-88b8-a4efda16d4c9 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 204 len: 0 microversion: 2.1 time: 0.451391 Aug 07 01:24:26.776297 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 435/850] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:24:26 2022] DELETE /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:26.785053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:26.785673 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:26.793052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.793782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.794272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.794979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.795438 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.795866 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.927868 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:26.935312 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-975b88a0-a995-403e-a82d-dd8783123448 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1508 microversion: 2.1 time: 0.154839 Aug 07 01:24:26.935879 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 416/851] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:26 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:24:27.957170 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:27.957876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:27.964052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.964531 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.964968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:27.965649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.966129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.966556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:28.098234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:28.105662 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-28af922e-58ae-4f48-9d51-74603b88a91d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1508 microversion: 2.1 time: 0.153346 Aug 07 01:24:28.106268 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 436/852] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:27 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:28.998074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1cd953-ea67-4ef2-a5e6-1b97263901e4", "name": "network-vif-deleted", "tag": "b8fbd05f-9663-4ed9-a8e3-996a54d6c644"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:29.008490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:29.008961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:29.009490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:29.022085 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] Creating event network-vif-deleted:b8fbd05f-9663-4ed9-a8e3-996a54d6c644 for instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 on hv-cinder-maste Aug 07 01:24:29.027335 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-b1f28ee3-18e4-4842-831c-8ca1cb3e3114 req-5d819297-576f-44da-829d-2790962c1697 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Aug 07 01:24:29.027931 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 417/853] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:29.127630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:29.128236 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:29.134217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:29.134703 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:29.135137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:29.135824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:29.136277 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:29.136701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:29.198276 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:29.212830 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa4ad0fb-6542-4dea-ae5c-b156b7767199 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 200 len: 1466 microversion: 2.1 time: 0.083555 Aug 07 01:24:29.212830 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 437/854] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:29 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 1466 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:30.227890 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:30.228733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: 0c1cd953-ea67-4ef2-a5e6-1b97263901e4] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:30.235128 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.236190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.236626 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.237328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.237778 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.238226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.251548 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] HTTP exception thrown: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Request method failure captured: Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 HTTP/1.1 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xLvNd-I3isnSu5qim6ZtzAjVLP5O9slOoH1qEh5k2fvFMuy_FbNh_b0E2ZtIQ6WGkvzEpj-XCdoxYTqVmxQgbAoXCs8ZNgcwxS4HeYneRzvMQ2nmjZ9qy0txnsPOYfYeX6t4673mi6CpUlEH58e_hbD8b0xQ3nTJ_jPkVRgofsRNOA Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:24:30.253172 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32cc230c70b341fca95fa1b962d73909", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 75266a74abbb4129bac206a7d5944466 Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. Aug 07 01:24:30.254718 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '0c1cd953-ea67-4ef2-a5e6-1b97263901e4'} Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:30.255505 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. Aug 07 01:24:30.256734 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:24:30.257872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Returning 404 to user: Instance 0c1cd953-ea67-4ef2-a5e6-1b97263901e4 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:30.257872 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6d896b04-23c1-45bc-983b-08b4935b4a5a tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4" status: 404 len: 111 microversion: 2.1 time: 0.031640 Aug 07 01:24:30.257872 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 418/855] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:30 2022] GET /compute/v2.1/servers/0c1cd953-ea67-4ef2-a5e6-1b97263901e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:24:30.264070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:30.264558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:30.271055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.271533 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.271960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.272637 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.273083 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.273499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.298542 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:30.672537 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-eb40d7fc-34e2-42fa-8fca-a33cefa06b9d tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 204 len: 0 microversion: 2.1 time: 0.412148 Aug 07 01:24:30.673704 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 438/856] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:24:30 2022] DELETE /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:30.681735 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:30.682585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:30.689179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.691437 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.691437 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.691437 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.691437 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.691869 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.821261 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:30.829027 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-07a332a5-42c1-445e-81cb-be19d754f498 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.151133 Aug 07 01:24:30.829703 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 419/857] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:30 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:31.850794 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:31.851489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:31.857433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:31.857946 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:31.877776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:31.877776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:31.877776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:31.877776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:31.986856 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:31.994138 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2eb67b6f-b60d-4075-b78d-7c0adb9f0a9c tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.147556 Aug 07 01:24:31.994691 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 439/858] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:31 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:33.015234 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:33.015838 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:33.023030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:33.023505 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:33.023932 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:33.024612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:33.025059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:33.025477 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:33.155522 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:33.162955 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5e557184-0293-4da9-a416-3bfdb5cf3133 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1522 microversion: 2.1 time: 0.151529 Aug 07 01:24:33.163510 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 420/859] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:33 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:33.844992 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f301d819-7d3d-4602-9592-2cf2cb0ddfdb", "name": "network-vif-deleted", "tag": "d3e13a5d-edf8-4a17-b0c0-636a246478f1"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:33.854812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:33.855278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:33.855744 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:33.859480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:33.866874 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] Creating event network-vif-deleted:d3e13a5d-edf8-4a17-b0c0-636a246478f1 for instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb on hv-cinder-maste Aug 07 01:24:33.871613 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-f1b255f7-00c3-4e47-9e1e-6f31083e01da req-f54e2f25-e84f-4720-be25-7f864a2e2087 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030190 Aug 07 01:24:33.872338 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 440/860] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:34.184201 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:34.184815 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:34.192645 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.193181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.193585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.194375 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.194790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.195216 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.228552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.229043 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.229481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.229953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lazy-loading 'fault' on Instance uuid f301d819-7d3d-4602-9592-2cf2cb0ddfdb {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:34.275318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75266a74abbb4129bac206a7d5944466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc230c70b341fca95fa1b962d73909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:34.283385 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b5625b17-2d5f-4109-85b3-1515c26272a5 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 200 len: 1311 microversion: 2.1 time: 0.103085 Aug 07 01:24:34.283948 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 421/861] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:34 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:35.309636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:35.310360 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] [instance: f301d819-7d3d-4602-9592-2cf2cb0ddfdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:35.317601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:35.318126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:35.318586 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:35.319295 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:35.319781 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:35.320206 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:35.333316 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] HTTP exception thrown: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Request method failure captured: Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb HTTP/1.1 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xLvNd-I3isnSu5qim6ZtzAjVLP5O9slOoH1qEh5k2fvFMuy_FbNh_b0E2ZtIQ6WGkvzEpj-XCdoxYTqVmxQgbAoXCs8ZNgcwxS4HeYneRzvMQ2nmjZ9qy0txnsPOYfYeX6t4673mi6CpUlEH58e_hbD8b0xQ3nTJ_jPkVRgofsRNOA Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:24:35.335315 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32cc230c70b341fca95fa1b962d73909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32cc230c70b341fca95fa1b962d73909", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 32cc230c70b341fca95fa1b962d73909 Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1805831602 Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 75266a74abbb4129bac206a7d5944466 Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1805831602-project Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. Aug 07 01:24:35.340365 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'f301d819-7d3d-4602-9592-2cf2cb0ddfdb'} Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:35.341210 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. Aug 07 01:24:35.343217 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:24:35.344491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] Returning 404 to user: Instance f301d819-7d3d-4602-9592-2cf2cb0ddfdb could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:35.344491 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5f651e7f-d28d-422d-87f3-75d10ce20481 tempest-ServerRescueNegativeTestJSON-1805831602 tempest-ServerRescueNegativeTestJSON-1805831602-project] 10.222.0.36 "GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb" status: 404 len: 111 microversion: 2.1 time: 0.031867 Aug 07 01:24:35.344491 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 441/862] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:35 2022] GET /compute/v2.1/servers/f301d819-7d3d-4602-9592-2cf2cb0ddfdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:24:35.577754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:35.578314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:35.585037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:35.585518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:35.585974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:35.586667 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:35.587119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:35.587541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:35.611397 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1ab708c6-3bd8-4510-83d5-cc126dfb4e84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/ips" status: 200 len: 152 microversion: 2.20 time: 0.037454 Aug 07 01:24:35.611978 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 422/863] 10.222.0.36 () {60 vars in 1289 bytes} [Sun Aug 7 01:24:35 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:24:38.887945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:38.888983 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:38.896663 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:38.897297 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:38.897793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:38.898586 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:38.899102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:38.900362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:38.925154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lazy-loading 'flavor' on Instance uuid e02c941d-57b1-4a65-af79-f6a8dde18c55 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:39.478847 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-fa64159d-57d2-4cb7-ac55-cc0ded96fd06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/action" status: 202 len: 0 microversion: 2.20 time: 0.594715 Aug 07 01:24:39.480783 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 442/864] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Aug 7 01:24:38 2022] POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:39.487942 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:39.489090 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:39.497084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:39.497563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:39.498066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:39.498764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:39.499210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:39.499625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:39.631590 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:39.639559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:39.641056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:39.642432 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2da29df8-1ccf-46ac-80b1-7cd3904e2765 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.158533 Aug 07 01:24:39.642995 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 423/865] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:39 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:40.665496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:40.666230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:40.674722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:40.674722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:40.674722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:40.674722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:40.675105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:40.675105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:40.807608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:40.816476 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:40.818006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:40.819174 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-7b04a8ee-e4a4-438b-90f8-e0fbbbbbb01a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.157936 Aug 07 01:24:40.819737 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 443/866] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:40 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:41.842851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:41.844328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:41.850959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:41.851443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:41.851878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:41.852577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:41.853199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:41.853781 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:41.997961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:42.006208 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:42.007711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:42.008861 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6d9fae35-dbf4-42f8-b648-162fcb7d3309 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.169995 Aug 07 01:24:42.009419 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 424/867] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:41 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:43.032246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:43.032889 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:43.035606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:43.041248 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:43.041775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:43.042258 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:43.042979 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:43.043440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:43.043869 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:43.179898 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:43.188182 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:43.190477 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:43.191632 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-36caa8be-e385-4187-9c35-83127098c7c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.163613 Aug 07 01:24:43.206257 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 444/868] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:43 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:44.219813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:44.227122 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:44.233990 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:44.234479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:44.234973 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:44.236352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:44.236808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:44.237233 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:44.370956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:44.378924 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:44.380474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:44.381627 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a138497b-0228-4380-b82a-5b55fe0f7053 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.170044 Aug 07 01:24:44.382207 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 425/869] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:44 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:45.404257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:45.404762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:45.411254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:45.411739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:45.412173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:45.412865 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:45.413317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:45.413739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:45.545233 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:45.553883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:45.555391 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:45.556543 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8189c7f5-4e5e-4dcc-8818-535831068589 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.156382 Aug 07 01:24:45.557096 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 445/870] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:45 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:46.579110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:46.579802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:46.582231 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:46.587139 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:46.587620 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:46.588056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:46.588743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:46.589196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:46.589620 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:46.592164 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=91 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:46.723060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:46.731186 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:46.732664 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:46.733937 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b44c7e2c-3c6e-4de2-b035-d174de0b8a2c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.158730 Aug 07 01:24:46.734585 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 426/871] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:46 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:47.757295 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:47.757931 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:47.763891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:47.764369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:47.764801 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:47.765482 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:47.765958 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:47.766910 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:47.896706 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:47.904609 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:47.906129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:47.907790 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1c797b57-a906-4ad2-bfcf-ca62d78894d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.154450 Aug 07 01:24:47.908349 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 446/872] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:47 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:48.931492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:48.932108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:48.939958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:48.940476 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:48.940914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:48.941613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:48.942129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:48.942558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:49.074177 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:49.082193 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:49.089663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:49.089663 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-efec0e6a-e585-457a-b843-4c8753b24def tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.157600 Aug 07 01:24:49.089663 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 427/873] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:48 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:50.107670 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:50.108269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:50.114385 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:50.114860 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:50.115287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:50.115995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:50.116447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:50.116864 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:50.247824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:50.255247 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:50.256738 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:50.257909 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-79a673c7-ddf3-4a74-a3bb-43e5a7e346a0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.154265 Aug 07 01:24:50.258460 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 447/874] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:50 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:51.280724 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:51.281420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:51.289195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:51.289683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:51.290156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:51.290860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:51.291318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:51.291746 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:51.432908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:51.451079 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:51.451079 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:51.451079 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a8c54ddf-c34f-4b5c-8c25-ca40f1d772b1 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.167398 Aug 07 01:24:51.451417 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 428/875] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:51 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:52.473773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:52.473773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:52.479996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:52.480487 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:52.480932 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:52.481622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:52.482099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:52.482524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:52.616779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:52.622314 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:52.623984 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:52.625201 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-688e5aaa-5b2d-4852-b569-a64e69d57722 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.156709 Aug 07 01:24:52.625755 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 448/876] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:52 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:53.647092 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:53.652163 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:53.654433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.654951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.655385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.656092 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.656545 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.656970 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.787922 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:53.795769 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:53.797321 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:53.798494 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e374ea07-d028-4b06-86e8-3012f324c854 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.155493 Aug 07 01:24:53.799053 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 429/877] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:53 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:54.822584 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:54.823371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:54.829294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:54.829891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:54.830396 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:54.831151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:54.831659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:54.832120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:54.961765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:54.967509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:54.969002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:54.970263 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-87f34c56-ff1f-4d7f-a916-ba43b78c337d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.151546 Aug 07 01:24:54.970896 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 449/878] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:54 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:55.992796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:55.993423 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:55.999845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:56.000323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:56.000752 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:56.001431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:56.001904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:56.005728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:56.173446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:56.181779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:56.183297 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:56.184614 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e35302ec-f6ac-4388-b6d8-1c8212da6eca tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.195783 Aug 07 01:24:56.185177 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 430/879] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:55 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:57.207732 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:57.208362 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:57.214754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:57.215243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:57.215684 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:57.216405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:57.216862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:57.217308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:57.352292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:57.360517 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:57.362054 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:57.363202 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-399777a4-1521-4652-a097-388e0471c717 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.159319 Aug 07 01:24:57.363761 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 450/880] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:57 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:58.388106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:58.388751 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:58.398257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.398257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.398257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.398587 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.398757 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.399381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.620172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:58.634732 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:58.636427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:58.637666 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-33f8b480-a8b0-40ce-a9fd-93f223cbf684 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.253707 Aug 07 01:24:58.638259 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 431/881] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:58 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:59.662392 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:59.663283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:59.669690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:59.670200 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:59.670634 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:59.671324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:59.671778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:59.672200 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:59.818862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:59.827317 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:59.828819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:59.830018 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9eb845a7-874e-4430-9ca1-3cf77a41e424 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.172423 Aug 07 01:24:59.830572 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 451/882] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:59 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:00.148917 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "name": "network-vif-plugged", "status": "completed", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:00.160604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:00.161161 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:00.161764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:00.178080 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] Creating event network-vif-plugged:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:25:00.184290 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-cd663b46-a5d7-4100-8e25-e71cbcfb46e6 req-045b306a-95b8-4708-809d-98bcc71c3625 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040762 Aug 07 01:25:00.184989 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 432/883] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:00.854694 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:00.855306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:00.861325 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:00.861807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:00.862310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:00.862999 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:00.863451 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:00.863938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:01.001330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:01.009310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:01.010823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:01.011967 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-19022f7b-ecc7-4df8-a109-d1d7b47e4879 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.161297 Aug 07 01:25:01.012554 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 452/884] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:00 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:02.037517 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:02.038243 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:02.044463 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:02.044949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:02.045393 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:02.046117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:02.046574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:02.047001 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:02.175880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:02.184525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:02.186065 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:02.187224 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d5960457-ac5f-4ee5-b1a7-7098f0b0aa27 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.155450 Aug 07 01:25:02.187789 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 433/885] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:02 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:03.209993 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:03.210652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:03.216536 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:03.217137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:03.217537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:03.218239 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:03.218689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:03.219109 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:03.350298 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:03.358435 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:03.359926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:03.361077 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-94ccb681-3edc-4794-af1b-a380a3f9bb85 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1745 microversion: 2.20 time: 0.155277 Aug 07 01:25:03.361629 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 453/886] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:03 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:04.388285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:04.389566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:04.397310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:04.401611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:04.402190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:04.403578 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:04.404350 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:04.404993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:04.553708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:04.562214 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:04.564744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:04.566166 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cb1932cd-a784-4830-9912-24654f639773 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.185327 Aug 07 01:25:04.566793 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 434/887] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:04 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:05.595768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:05.603558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:05.610671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:05.610995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:05.611539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:05.612364 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:05.612919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:05.613578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:05.757199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:05.765729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:05.767252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:05.768590 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0e0dd32d-1f78-4129-8f48-1e679107cbdf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.176785 Aug 07 01:25:05.769150 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 454/888] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:05 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:06.793038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:06.793695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:06.801117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:06.803623 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:06.804717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:06.806425 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:06.807052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:06.807811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:06.947546 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:06.955923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:06.957504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:06.959134 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eedf5996-cc7f-4414-b90e-c49676d52edf tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.170204 Aug 07 01:25:06.960008 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 435/889] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:06 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:07.984819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:07.985421 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:07.992583 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:07.993066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:07.993494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:07.994215 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:07.994658 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:07.995076 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:08.128988 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:08.138353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:08.139975 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:08.140672 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3428529d-e667-45c8-9f56-c974d42d4983 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.159878 Aug 07 01:25:08.141230 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 455/890] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:07 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:09.177887 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:09.182877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:09.190731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:09.191823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:09.192469 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:09.193347 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:09.194454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:09.195044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:09.370825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:09.384554 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:09.386516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:09.393752 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-00c9313d-e5b9-46b4-9521-53945246d58d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.226825 Aug 07 01:25:09.393752 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 436/891] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:09 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:10.413909 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:10.414651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:10.423914 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:10.424730 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:10.425420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:10.426278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:10.427492 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:10.427935 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:10.430825 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.573331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:10.581681 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:10.583346 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:10.585123 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-20288778-2cab-42ea-ac9a-b275ebccc60e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.175821 Aug 07 01:25:10.585756 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 456/892] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:10 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:11.608629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:11.609501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:11.616562 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:11.617142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:11.617649 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:11.618558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:11.619158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:11.619602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:11.761509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:11.769625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:11.772063 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:11.773485 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-67808396-ce9c-41f1-aa29-388e667abda4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.168798 Aug 07 01:25:11.773921 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 437/893] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:11 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:12.800854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:12.802424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:12.811946 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:12.812665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:12.813331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:12.814498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:12.815244 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:12.815862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:12.984848 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:12.994062 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:12.995731 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:12.996897 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-58ceae2a-fa5b-4d4d-a878-288d69f9068a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.203736 Aug 07 01:25:13.010590 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 457/894] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:12 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:14.020599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:14.022494 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:14.030794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:14.031563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:14.032290 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:14.033306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:14.034011 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:14.034648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:14.226099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:14.237153 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:14.238996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:14.241111 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cbae0765-09f9-4aaa-81a1-7070d48f5c60 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.225366 Aug 07 01:25:14.242114 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 438/895] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:14 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:15.264959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:15.265557 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:15.272655 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:15.273255 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:15.273773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:15.274596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:15.275082 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:15.275553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:15.413775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:15.421736 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:15.423281 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:15.424438 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9b1da214-7e62-4ebf-a075-f266b26bdd92 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.163689 Aug 07 01:25:15.424987 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 458/896] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:15 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:16.448781 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:16.449390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:16.456059 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.469563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.469563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:16.469563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.469563 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.470886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:16.673474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:16.680429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:16.681949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:16.683098 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4b46759b-7042-4462-a7f8-dd8ffd791698 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.238376 Aug 07 01:25:16.683653 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 439/897] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:16 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:17.706265 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:17.706964 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:17.709032 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=30 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:17.714613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.715100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.715536 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.716270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.716768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.717191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.850530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:17.858968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:17.860499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:17.865326 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2f7029de-cc6f-4ec2-aa37-95613d106104 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1740 microversion: 2.20 time: 0.159418 Aug 07 01:25:17.865326 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 459/898] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:17 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:18.886660 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:18.887303 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:18.893695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:18.894204 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:18.894639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:18.895354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:18.895804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:18.896227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:19.024556 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:19.026910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=84 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:19.033196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:19.034728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:19.035887 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e6d61804-5b30-49cd-ae99-aa0410a13abe tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1722 microversion: 2.20 time: 0.153230 Aug 07 01:25:19.036438 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 440/899] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:18 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:20.059153 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:20.059917 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:20.067669 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.068211 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.069192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:20.070084 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.070592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.072562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:20.208870 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:20.218590 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:20.220111 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:20.221692 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e7bc455c-6697-4f77-82d2-f51cdf6cebed tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1722 microversion: 2.20 time: 0.166988 Aug 07 01:25:20.222287 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 460/900] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:20 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:21.245246 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:21.246596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:21.252821 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=30 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:21.254474 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:21.255180 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:21.255884 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:21.257410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:21.257982 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:21.258518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:21.397272 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:21.407355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:21.407355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:21.408050 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-296f30e6-e598-45be-85b4-9c257963c3ac tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1725 microversion: 2.20 time: 0.167456 Aug 07 01:25:21.408611 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 441/901] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:21 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:21.431146 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92b2cdf3-bd3e-4ac4-b54f-59b7a37dc35f"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:21.433553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:21.439470 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:21.439947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:21.440370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:21.441049 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:21.441494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:21.442058 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.219559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "name": "network-vif-unplugged", "status": "completed", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:22.229404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.229907 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.230333 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.241518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.compute.server_external_events [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] Unable to find a host for instance e02c941d-57b1-4a65-af79-f6a8dde18c55. Dropping event network-vif-unplugged {{(pid=118307) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 01:25:22.242362 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-72c80642-9c88-45c3-8929-e3dedf6411d1 req-c9f50d4b-b943-46be-9829-93786563746b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026663 Aug 07 01:25:22.242935 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 442/902] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 07 01:25:22.499547 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-18d906dd-8052-4761-b11e-21ff3857ea84 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.072711 Aug 07 01:25:22.500299 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 461/903] 10.222.0.36 () {62 vars in 1364 bytes} [Sun Aug 7 01:25:21 2022] POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments => generated 188 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:25:22.619055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:22.619551 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:22.625865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.626355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.626768 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.627450 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.627903 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.628323 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:23.306654 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0d1ec061-1e30-404b-9088-d4cc30e20cb7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments/92b2cdf3-bd3e-4ac4-b54f-59b7a37dc35f" status: 202 len: 0 microversion: 2.20 time: 0.692023 Aug 07 01:25:23.307250 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 443/904] 10.222.0.36 () {60 vars in 1457 bytes} [Sun Aug 7 01:25:22 2022] DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments/92b2cdf3-bd3e-4ac4-b54f-59b7a37dc35f => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:23.365639 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:23.366268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:23.372785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:23.373205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:23.373633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:23.374334 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:23.374779 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:23.375193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:23.404080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118310) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:25:23.714729 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0737efbf-a5ea-427a-b170-e238da2679ea tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/action" status: 202 len: 0 microversion: 2.20 time: 0.352664 Aug 07 01:25:23.715394 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 462/905] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Aug 7 01:25:23 2022] POST /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:23.723404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:23.724014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:23.885295 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:23.885782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:23.886240 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:23.886958 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:23.887431 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:23.887851 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:24.020257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:24.028631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:24.030547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:24.031379 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5e68dfaa-83ff-42ec-bc4f-6ac491b7f71b tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1673 microversion: 2.20 time: 0.311870 Aug 07 01:25:24.031939 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 444/906] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:23 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:25.056463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:25.057085 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:25.070494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.070494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.070494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:25.070494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.070939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.070939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:25.197621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:25.206500 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:25.208775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:25.210220 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4ea445f1-9a0d-4191-bf96-4f92aa6645c8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1675 microversion: 2.20 time: 0.158780 Aug 07 01:25:25.211456 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 463/907] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:25 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:26.236543 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:26.237155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:26.244264 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:26.244748 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:26.245182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:26.245995 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:26.246454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:26.246903 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:26.377360 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:26.385509 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:26.387053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:26.388217 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1e32198d-bb59-434e-9aa0-129be99af978 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.155666 Aug 07 01:25:26.388775 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 445/908] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:26 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:27.411888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:27.412479 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:27.420066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.420598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.421458 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.422149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.422791 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.423352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.593214 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:27.603416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:27.609117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:27.609117 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-167fa9f6-dbff-4db1-86cd-88e2d893e7eb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.198548 Aug 07 01:25:27.609117 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 464/909] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:27 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:28.629735 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:28.630388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:28.637442 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:28.637964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:28.638402 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:28.639089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:28.639539 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:28.639961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:28.793394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:28.803049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:28.806728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:28.808074 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-70c1bd85-a404-46ee-bc10-b2a2bbab34c4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.182105 Aug 07 01:25:28.808632 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 446/910] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:28 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:29.831962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:29.837308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:29.839682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:29.840173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:29.840608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:29.841308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:29.841761 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:29.842226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:29.997847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:30.006722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:30.008728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:30.010190 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-eb220549-8bb9-41c5-a630-9672fbbf9c2a tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.182010 Aug 07 01:25:30.022144 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 465/911] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:29 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:31.034692 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:31.035357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:31.046320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:31.046320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:31.046320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:31.046320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:31.046613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:31.046613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:31.144082 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:25:31.148920 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 (ip 10.222.0.36) !!! Aug 07 01:25:31.203898 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:31.214904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:31.217484 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:31.219145 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e63e3e1a-26dc-4a39-9e29-1c0cbe5a3bcb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.188489 Aug 07 01:25:31.219869 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 447/912] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:31 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:32.245266 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:32.246884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:32.256168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:32.257149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:32.257961 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:32.259665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:32.260302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:32.260798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:32.439171 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:32.448051 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:32.449713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:32.451044 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ed6a033f-1bc2-4aec-a474-b9e69e4db3b0 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.211713 Aug 07 01:25:32.457318 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 466/913] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:32 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:32.520661 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:32.522126 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:32.529092 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:32.529642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:32.530343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:32.531056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:32.531712 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:32.532340 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:32.563703 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-96724db7-2c0e-4271-84f0-7ad6d6d15e37 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/ips" status: 200 len: 146 microversion: 2.1 time: 0.047876 Aug 07 01:25:32.572936 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 448/914] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:25:32 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:33.478519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:33.479067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:33.485877 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:33.486734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:33.487284 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:33.488145 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:33.488765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:33.489330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:33.662467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:33.673480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:33.675321 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:33.677250 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ecf9001c-6f60-4c2a-8035-7e78a5de8f94 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.204360 Aug 07 01:25:33.686402 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 467/915] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:33 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:34.701731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:34.702394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:34.710016 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:34.710842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:34.711449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:34.712167 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:34.712638 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:34.713095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:34.884998 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:34.892949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:34.894492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:34.895647 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b7c9e01b-4942-4957-a3ba-b1afe2200b63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.198143 Aug 07 01:25:34.896208 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 449/916] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:34 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:35.919204 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:35.919846 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:35.926080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:35.926575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:35.927005 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:35.927697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:35.928150 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:35.928575 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:36.080168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:36.088461 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:36.089989 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:36.091148 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ff3ed439-b5f0-4697-b82f-2efa68df2921 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.175988 Aug 07 01:25:36.091701 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 468/917] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:35 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:36.543489 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c513de2-1a30-4663-b4a5-7fb82e3e3971"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:36.546030 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:36.552534 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:36.553344 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:36.553486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:36.554178 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:36.554632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:36.555852 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:37.115000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:37.115536 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:37.122100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:37.122578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:37.123006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:37.123681 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:37.124129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:37.124548 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:37.127172 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:37.262292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:37.270174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:37.281641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:37.281641 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-88ebabd1-b93f-4761-85c7-f5c661cc1179 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.161805 Aug 07 01:25:37.281641 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 469/918] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:37 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:38.296872 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:38.297492 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:38.303572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.304047 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.304475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:38.305179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.305627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.306415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:38.436884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:38.444852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:38.446867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:38.448058 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-60d1083b-47da-447e-9fac-8085e5f8ce81 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.155495 Aug 07 01:25:38.448613 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 470/919] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:38 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:39.471871 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:39.472556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:39.478488 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:39.478981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:39.479427 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:39.480112 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:39.480572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:39.481001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:39.610497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:39.618920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:39.620439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:39.621598 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f1475b65-5219-4897-9e36-516a4fe9c7b5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.153787 Aug 07 01:25:39.622203 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 471/920] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:39 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:40.645006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:40.645613 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:40.651508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:40.651991 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:40.652422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:40.653137 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:40.653588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:40.654050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:41.020736 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:41.030469 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:41.032020 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:41.033167 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d85d7a04-60c0-441d-ba13-54bf91866d63 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.392114 Aug 07 01:25:41.033751 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 472/921] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:40 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:42.056800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:42.057527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:42.065520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.070110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.070562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:42.071286 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.071743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.072168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:42.206308 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:42.214602 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:42.216166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:42.217397 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e14b7e3c-abf7-440b-8a26-cabba51af764 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.164864 Aug 07 01:25:42.217958 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 473/922] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:42 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:42.443237 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ee22ce1b-9686-4326-afc2-1e6bbbb28b78 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.903867 Aug 07 01:25:42.447254 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 450/923] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:25:36 2022] POST /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 194 bytes in 5906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:43.240970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:43.241854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:43.248426 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:43.256154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:43.256154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:43.256154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:43.256154 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:43.256513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:43.388410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:43.397229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:43.399040 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:43.400071 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1cc25564-70a1-4245-8e4f-b0582189f3bb tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.163140 Aug 07 01:25:43.400636 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 474/924] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:43 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:44.424067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:44.425665 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:44.435559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.436336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.437008 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.437912 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.438527 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.439134 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.592399 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:44.601957 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:44.603460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:44.605334 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7221b691-d002-44d7-b095-150fd19669c7 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.185725 Aug 07 01:25:44.606554 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 451/925] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:44 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:44.686596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:44.688865 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:44.694952 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.695642 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.696079 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.696771 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.697217 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.697636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.731942 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c4ea9cef-20c2-48fa-881a-28dc635c6936 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048943 Aug 07 01:25:44.732816 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 475/926] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:25:44 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:44.743328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:44.746109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:44.750572 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.751064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.751529 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.752226 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.752682 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.753106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.782614 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b906f912-25f8-456d-87f9-9744fb111748 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971" status: 200 len: 194 microversion: 2.1 time: 0.043575 Aug 07 01:25:44.783385 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 452/927] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Aug 7 01:25:44 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:45.629900 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:45.630505 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:45.636302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:45.636780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:45.638001 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:45.638507 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:45.638972 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:45.639369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:45.940823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:45.948716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:45.950386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:45.951550 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d86d4310-63f6-4638-ac70-65358b6f1c4e tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.325610 Aug 07 01:25:45.952109 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 476/928] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:45 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:46.235137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.235584 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:46.235852 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.242682 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.243926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.243926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.244912 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.245441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.245664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.246018 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.246166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.246762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.258280 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] Creating event network-changed:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:25:46.263680 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-678ffc26-437b-46d4-b8c7-0e6f55363694 req-2c12110e-6241-4247-9ce0-fd4eb1dfcef7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032863 Aug 07 01:25:46.264784 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 477/929] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:46.280967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:25:46.316766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:46.479188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf62de8-7fc6-4bde-aa2b-50213a6619f5"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:46.482853 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.491474 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.493046 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.493653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.494569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.495783 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.496420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.602443 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1ae9327d-bb5b-4776-af9e-ebd4bce6bcb2 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 204 len: 0 microversion: 2.1 time: 0.373928 Aug 07 01:25:46.603257 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 453/930] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:25:46 2022] DELETE /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:46.616449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.617461 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.624441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.624931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.625366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.626101 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.626535 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.627157 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.767512 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:46.775632 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a1cd736b-1f99-4223-a955-2264911d3e8a tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.166492 Aug 07 01:25:46.776220 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 454/931] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:46 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:46.834955 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "name": "network-vif-plugged", "status": "completed", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:46.845336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.846109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.846609 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.858633 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] Creating event network-vif-plugged:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:25:46.864485 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f5ac1b99-42e9-4537-8487-870ccbe2b10e req-eeee846c-eb4c-4b8a-b86e-308cdabc6b41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Aug 07 01:25:46.864485 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 455/932] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:46.974799 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.975770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.983707 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.984409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.985034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.985856 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.986308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.986734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:47.125450 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.134046 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.135582 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.136744 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-de6a9378-bac6-48ca-acd7-c304bc197d06 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.166243 Aug 07 01:25:47.137594 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 456/933] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:46 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:47.797293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:47.797951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:47.805516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:47.806080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:47.806516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:47.807204 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:47.807650 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:47.808063 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.045116 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.052698 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-82078ee9-bbc3-4c57-8085-86be00e376ee tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1568 microversion: 2.1 time: 0.259928 Aug 07 01:25:48.053302 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 457/934] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:47 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:48.160038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:48.160796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:48.166901 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.169953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.169953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.169953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.169953 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.170336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.301946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.309951 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.311627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.312792 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-04a28da1-b59d-411a-a3fa-ec0bebb1677c tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.156930 Aug 07 01:25:48.313346 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 458/935] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:48 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:48.450359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-652686098", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "f9d38288-4ed5-48ce-9f18-6a2665f4cad7"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:48.507806 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] validate_networks() for [('f9d38288-4ed5-48ce-9f18-6a2665f4cad7', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:25:48.529129 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c5172810-0c52-4281-9c17-bd00c4ad2443 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "POST /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.053384 Aug 07 01:25:48.533250 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 478/936] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:25:46 2022] POST /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 194 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:25:49.075412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:49.076113 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:49.090725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.090725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.090725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.090725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.091986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.091986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.223129 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.232035 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6bacae5e-7659-4c6c-b5e4-e4556833f893 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1450 microversion: 2.1 time: 0.160885 Aug 07 01:25:49.232610 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 479/937] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:49 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:49.238064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:25:49.239113 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:25:49.239763 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:25:49.240343 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:25:49.240933 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:25:49.250662 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.251370 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.251633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.252361 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.252813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.253238 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.270629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Getting quotas for project 6692544b38264b1c94104e234259848b. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:25:49.274639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Getting quotas for user 7dbfda28a57647f1955e38acf410d18f and project 6692544b38264b1c94104e234259848b. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:25:49.285850 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:25:49.288111 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:25:49.337280 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:49.337697 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:49.343810 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.344289 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.344722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.345417 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.345897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.346330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.398998 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-60ed0acb-b794-4b3c-bc65-7e6ad75a4e30 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952621 Aug 07 01:25:49.400252 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 459/938] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:25:49.412187 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2729945-9f9a-47f2-bf30-446132a39962 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:49.412905 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d2729945-9f9a-47f2-bf30-446132a39962 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:49.478455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d2729945-9f9a-47f2-bf30-446132a39962 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.487452 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d2729945-9f9a-47f2-bf30-446132a39962 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1218 microversion: 2.1 time: 0.079951 Aug 07 01:25:49.488457 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 460/939] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:49 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:49.498904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0077940a-b8fc-4938-b60e-caa9ea2e20f3", "name": "network-vif-deleted", "tag": "2d4ef05b-73c5-4921-89b4-d1b58be2a944"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:49.508334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.508904 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.509814 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.523390 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] Creating event network-vif-deleted:2d4ef05b-73c5-4921-89b4-d1b58be2a944 for instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 on hv-cinder-maste Aug 07 01:25:49.525605 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.529268 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-c0970145-1c48-431f-9149-750bdca33f0b req-da82c216-83ee-4f95-8972-638041bd9eee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039055 Aug 07 01:25:49.530335 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 461/940] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:49.534161 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.535756 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.536809 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-96a50ab0-5685-457b-b3f1-f70821b4a3b8 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.203919 Aug 07 01:25:49.537360 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 480/941] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:49 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:50.255078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:50.255777 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:50.262223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.262731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.263227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.263927 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.264385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.264811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.327081 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.334845 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f61df0d3-11b2-4620-886a-96ee3342e3da tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1219 microversion: 2.1 time: 0.084551 Aug 07 01:25:50.335411 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 462/942] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:50 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:50.510188 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:50.510874 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:50.514166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:50.518764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.519245 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.519680 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.520365 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.520814 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.521229 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.561160 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:50.563538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:50.567849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.568335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.568771 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.569464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.569939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.570359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.583231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.591560 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3d083ee7-211f-4a2b-a67b-4b2d1e24cfed tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1222 microversion: 2.1 time: 0.085429 Aug 07 01:25:50.592235 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 481/943] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:50 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:50.712062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.720172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.721685 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.722889 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20efe26a-3cd1-4812-990a-23c671aa36cc tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.166716 Aug 07 01:25:50.723442 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 463/944] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:50 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:51.356949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.357555 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.363833 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.364316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.364748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.365433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.365912 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.366457 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.435827 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1bbc1683f24a5aa356438e533e1fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de628a664a84c279bfdaa7105972fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.443517 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-73daac49-7b3f-40ff-a35e-74e60b29c243 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 200 len: 1219 microversion: 2.1 time: 0.091336 Aug 07 01:25:51.444078 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 482/945] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:51.611515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.612132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.614700 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:51.619400 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.619888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.620325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.621102 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.622095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.622510 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.692173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.699724 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0cf3a4f3-405b-495f-a70b-419f197c4b40 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1222 microversion: 2.1 time: 0.092160 Aug 07 01:25:51.700475 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 464/946] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:51.744709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.745310 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.751820 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.752306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.752730 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.753416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.753885 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.754423 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.839358 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.843420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.851830 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.852453 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.852962 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.853810 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.854385 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.854873 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.894933 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-28f3633c-fe19-4812-a45e-190da2f9ed87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062670 Aug 07 01:25:51.895513 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 465/947] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:25:51.910665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.919301 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.920947 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.922135 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d8e93b6e-70e4-473e-939d-f952d42cc017 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1731 microversion: 2.20 time: 0.181335 Aug 07 01:25:51.922688 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 483/948] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:52.043940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.044446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.050788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.051270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.051705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.052393 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.053105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.053695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.087857 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-67cd5614-e657-4c10-aec6-01d17a0ee024 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971" status: 200 len: 194 microversion: 2.1 time: 0.048034 Aug 07 01:25:52.088455 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 466/949] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Aug 7 01:25:52 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:52.099759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.100251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.106561 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.107065 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.107553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.108290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.108748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.109173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.194757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lazy-loading 'services' on Instance uuid e7c64516-610b-455f-92db-0dfdcb1144bb {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:25:52.196878 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:52.443270 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9daee7cc-7d7a-41d8-b5f4-eda28447385a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971" status: 202 len: 0 microversion: 2.1 time: 0.347126 Aug 07 01:25:52.443768 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 484/950] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:25:52 2022] DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/8c513de2-1a30-4663-b4a5-7fb82e3e3971 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:25:52.464625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.465537 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] [instance: 0077940a-b8fc-4938-b60e-caa9ea2e20f3] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.472519 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.473026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.473459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.474965 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.475753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.476218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.490369 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] HTTP exception thrown: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Request method failure captured: Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 HTTP/1.1 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xLp_XdWjyPKF8sNpgBfeXROT3AU-QyEZY8qr4Lxi-YsuX_rgIbBvcCc7jCO6_9eyEyZXdGXrSfMtw3IOnCQrI-4YlGpUogYBrrTX4QuqcarEeDjrswxMdFcM6_k0yngvswhgIYsAHDXj5YbmkD9w3UIY8c2F_IwDQ8sX3JtpGDB8jg Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 4de628a664a84c279bfdaa7105972fd4 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-TestShelveInstance-1203256532 Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:25:52.492022 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4de628a664a84c279bfdaa7105972fd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4de628a664a84c279bfdaa7105972fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4de628a664a84c279bfdaa7105972fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4de628a664a84c279bfdaa7105972fd4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-TestShelveInstance-1203256532 Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 4de628a664a84c279bfdaa7105972fd4 Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-TestShelveInstance-1203256532 Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-TestShelveInstance-1203256532-project Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: cb1bbc1683f24a5aa356438e533e1fb1 Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-TestShelveInstance-1203256532-project Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. Aug 07 01:25:52.494186 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '0077940a-b8fc-4938-b60e-caa9ea2e20f3'} Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:25:52.495220 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. Aug 07 01:25:52.497308 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:25:52.498954 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Returning 404 to user: Instance 0077940a-b8fc-4938-b60e-caa9ea2e20f3 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:25:52.498954 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e6e9f526-0dc0-4b11-b94e-62c608845080 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3" status: 404 len: 111 microversion: 2.1 time: 0.033118 Aug 07 01:25:52.498954 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 467/951] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:52 2022] GET /compute/v2.1/servers/0077940a-b8fc-4938-b60e-caa9ea2e20f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:52.721139 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.725355 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.731486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb45380f-969c-4c80-b398-4f2f8dc56e31 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] Calling method '.version_select at 0x7fb7d0ce93a0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.749945 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.750432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.750863 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.751572 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.753807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.753807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.822532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:52.830334 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-de930c6b-9f3d-4b52-a695-cca6d4661e14 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1270 microversion: 2.1 time: 0.113351 Aug 07 01:25:52.830901 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 485/952] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:52 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:52.838292 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bb45380f-969c-4c80-b398-4f2f8dc56e31 tempest-TestShelveInstance-1203256532 tempest-TestShelveInstance-1203256532-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1100820251" status: 202 len: 0 microversion: 2.1 time: 0.111542 Aug 07 01:25:52.838856 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 468/953] 10.222.0.36 () {58 vars in 1254 bytes} [Sun Aug 7 01:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1100820251 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:25:52.944689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.945264 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.951331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.951817 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.952250 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.952938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.953390 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.953816 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.087550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.096053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.097556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.098738 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-517b765b-6723-4bca-8c71-c982c263f23d tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1718 microversion: 2.20 time: 0.158146 Aug 07 01:25:53.099300 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 486/954] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:52 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:53.853948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:53.854709 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:53.863090 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:53.863815 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:53.864757 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.865682 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:53.866348 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:53.866956 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.942872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.952208 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b4cd929e-cb86-4752-a250-f958b341e5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1288 microversion: 2.1 time: 0.103767 Aug 07 01:25:53.952783 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 469/955] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:53 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:54.633796 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:54.634877 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:54.641978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.642468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.642903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.643601 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.644054 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.644478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.675622 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bbf94782-6f2e-4ece-809f-3bde27c98a46 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/bbf62de8-7fc6-4bde-aa2b-50213a6619f5" status: 200 len: 194 microversion: 2.1 time: 0.045701 Aug 07 01:25:54.681596 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 487/956] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Aug 7 01:25:54 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/bbf62de8-7fc6-4bde-aa2b-50213a6619f5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:54.687728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:54.688230 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:54.694115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.694602 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.695044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.695739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.696196 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.696622 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.779119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lazy-loading 'services' on Instance uuid e7c64516-610b-455f-92db-0dfdcb1144bb {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:25:54.972980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:54.974045 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:54.981668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.982546 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.983543 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.984589 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.985267 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.986291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.075938 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-22a501f6-e179-4d92-b42f-7c7eb841e886 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/bbf62de8-7fc6-4bde-aa2b-50213a6619f5" status: 202 len: 0 microversion: 2.1 time: 0.392412 Aug 07 01:25:55.077486 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 470/957] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:25:54 2022] DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments/bbf62de8-7fc6-4bde-aa2b-50213a6619f5 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:25:55.155305 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.162299 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-69a80c3f-82d6-4c53-9c8e-ee10f75d9746 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.193392 Aug 07 01:25:55.162877 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 488/958] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:54 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:56.186067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.188220 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.197964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.198607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.199328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.200093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.213010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.215888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.288862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.288862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.291178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.291686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.292096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.292792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.293475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.293950 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.331201 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4f8a8e67-4c22-4fca-9a4a-131ed3957157 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053908 Aug 07 01:25:56.338084 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 489/959] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:25:56.471264 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.474116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.480268 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.480903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.481335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.482075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.482548 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.482969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.513533 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-51c52fbb-27e4-4e99-95d0-1da70ca8ae87 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046450 Aug 07 01:25:56.514175 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 490/960] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:25:56.518247 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:56.526124 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-29956604-6d8c-4fd9-b8ea-8db08bb9040a tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.346781 Aug 07 01:25:56.526487 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 471/961] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:56.582041 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.582696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.589075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.589558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.590937 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.591654 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.592400 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.592840 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.618888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:25:56.680569 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a089d8c-2a57-4ee6-83db-b80a4cc1d048", "tag": "7291d552-4bd7-4ffb-90bf-3a1d0a5064ee"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:56.691568 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.692054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.692768 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.707256 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] Creating event network-changed:7291d552-4bd7-4ffb-90bf-3a1d0a5064ee for instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 on hv-cinder-maste Aug 07 01:25:56.712354 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-1605711d-bf03-42de-8852-a49fcb3237a2 req-b56bb324-14dc-4bd8-813a-2f673c56bad9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Aug 07 01:25:56.712951 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 472/962] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:56.953151 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1620d0ef-770d-492f-98df-785290b77f91 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 204 len: 0 microversion: 2.1 time: 0.375343 Aug 07 01:25:56.953866 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 491/963] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:25:56 2022] DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:56.963558 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.966946 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.971219 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.971581 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.972015 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.972755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.973211 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.973631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.154875 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:57.163438 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dc9f4377-1b8b-48ea-a252-71a134da5701 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1675 microversion: 2.1 time: 0.204873 Aug 07 01:25:57.164019 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 473/964] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:57.548072 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:57.548759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:57.555338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:57.555829 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:57.556407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.557079 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:57.557659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:57.558119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.753067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:57.760604 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-77033712-8d71-4fd3-a7cc-d5344064d686 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.217705 Aug 07 01:25:57.761168 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 492/965] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:57 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:58.184680 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:58.185328 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:58.191981 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.192465 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.192897 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.193614 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.194104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.194525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.198848 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:58.396730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.405198 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e0220673-34b0-4db0-be97-32c00e0a25af tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1675 microversion: 2.1 time: 0.224304 Aug 07 01:25:58.405779 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 474/966] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:58 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:58.781996 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:58.782602 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:58.789050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.789530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.790205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.790899 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.791347 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.791763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.947370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.955898 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-11ba5521-6d4c-48fc-b77d-bf962046f5e5 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.178426 Aug 07 01:25:58.957024 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 493/967] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:58 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:59.427132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:59.427915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:59.430307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:59.435086 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.435575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.436040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:59.436744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.437204 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.437661 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:59.487269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:59.976461 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:59.977194 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:59.985008 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.985497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.985956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:59.986652 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.987105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.987530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.130090 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.145375 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e6a9bb86-ae0f-4216-8909-930259e5b9dc tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1675 microversion: 2.1 time: 0.721452 Aug 07 01:26:00.157029 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 475/968] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:59 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1675 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:00.208354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.216921 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f349e552-4263-4022-88d2-6a28c1fbda52 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.243223 Aug 07 01:26:00.229802 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 494/969] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:59 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:00.899357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c64516-610b-455f-92db-0dfdcb1144bb", "name": "network-vif-deleted", "tag": "50cbbb01-1828-4dd4-9eb3-dc7a2102256d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:00.911409 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.912006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.912507 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.926951 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] Creating event network-vif-deleted:50cbbb01-1828-4dd4-9eb3-dc7a2102256d for instance e7c64516-610b-455f-92db-0dfdcb1144bb on hv-cinder-maste Aug 07 01:26:00.934790 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-ee1d3533-c644-494c-9118-1f14212f6c09 req-fd0b95b6-e8b0-48d8-98ce-f07913839453 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038427 Aug 07 01:26:00.935529 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 476/970] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:01.170921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:01.171595 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:01.178170 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.178674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.185941 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.187042 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.187623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.187965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.237811 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:01.238831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:01.245083 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.245940 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.246678 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.247573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.248263 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.248767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.285075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:01.293067 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-72fadb23-dd3d-4f32-bb08-26efef1474ec tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1607 microversion: 2.1 time: 0.127108 Aug 07 01:26:01.294346 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 495/971] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:01 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1607 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:01.389047 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:01.396721 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5d433984-4a42-4d08-8f82-7dcccd35c6d3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.163162 Aug 07 01:26:01.397308 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 477/972] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:01 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:02.321594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:02.323122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:02.331059 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.331556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.331993 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.332717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.333177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.334056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.408057 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:02.419371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:02.420636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:02.427659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.428174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.428794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.429503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.430142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.430735 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.433095 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-14e99c90-c619-4733-9bf6-99c778cb7648 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1607 microversion: 2.1 time: 0.121213 Aug 07 01:26:02.434238 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 496/973] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:02 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1607 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:02.611937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:02.620159 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-64d0abfc-e3cf-4d5a-9dfe-7a0883f6eaa4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.204964 Aug 07 01:26:02.621510 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 478/974] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:02 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:03.455679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:03.456373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:03.472968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.473472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.473942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.474660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.475116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.475542 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.506763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.507246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.507683 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.508123 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lazy-loading 'fault' on Instance uuid e7c64516-610b-455f-92db-0dfdcb1144bb {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:03.550219 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8389683e844b989fe5cbe779327933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440652d4d24d4a34985625be49c12a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.557665 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-69fb404c-5ad1-4d27-9fb0-0a37972e5c1f tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 200 len: 1328 microversion: 2.1 time: 0.105835 Aug 07 01:26:03.558327 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 497/975] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:03 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:03.640767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:03.641630 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:03.648762 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.649267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.649706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.650438 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.650892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.651318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.791320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.798809 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4e7930c0-8139-4abe-a9b8-81627761fb4d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.161930 Aug 07 01:26:03.799320 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 479/976] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:03 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:04.580115 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.580804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:04.587807 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.588378 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.588877 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.589681 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.590239 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.590746 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.606131 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb HTTP/1.1 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:26:04.608461 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:04.610153 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'e7c64516-610b-455f-92db-0dfdcb1144bb'} Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:04.610954 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:04.612200 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:04.613309 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:04.613309 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ea3e6dcb-9563-43cb-9fbc-00f74422c2e9 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 404 len: 111 microversion: 2.1 time: 0.034285 Aug 07 01:26:04.614430 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 498/977] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:04 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:04.620228 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-89c046f2-aa05-4dbd-a46d-67df52854cfd tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '.version_select at 0x7fb7d153f5e0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.691005 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-89c046f2-aa05-4dbd-a46d-67df52854cfd tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318756901" status: 202 len: 0 microversion: 2.1 time: 0.075068 Aug 07 01:26:04.691664 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 480/978] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Aug 7 01:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318756901 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:26:04.818785 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.819397 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:04.825600 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.826127 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.826564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.827292 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.827798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.828225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.961398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:04.963894 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:04.971548 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-213778c1-3f3a-490e-a29a-a44a34a79a5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.156512 Aug 07 01:26:04.972122 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 499/979] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:04 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:05.994657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:05.995273 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:06.003610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:06.004147 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:06.004541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:06.005230 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:06.005685 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:06.006142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:06.132719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:06.140300 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-96f72574-9724-4bba-9f88-141284737d1e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.149657 Aug 07 01:26:06.140866 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 481/980] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:05 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:06.552002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a089d8c-2a57-4ee6-83db-b80a4cc1d048", "name": "network-vif-plugged", "status": "completed", "tag": "7291d552-4bd7-4ffb-90bf-3a1d0a5064ee"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:06.562861 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:06.563340 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:06.563769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:06.574410 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] Creating event network-vif-plugged:7291d552-4bd7-4ffb-90bf-3a1d0a5064ee for instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 on hv-cinder-maste Aug 07 01:26:06.579736 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-34be20f7-ddcf-477f-a0c0-8b6df08efd34 req-5652f69d-ef49-4e8c-84f9-71dc94010357 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Aug 07 01:26:06.580318 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 500/981] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:07.160659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:07.161421 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:07.168122 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.168610 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.169049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.169803 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.170248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.170675 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.303296 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:07.311603 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4eb002c3-df55-468a-86d8-309fa53e6d8f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.154824 Aug 07 01:26:07.315585 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 482/982] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:07 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:08.162554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:08.163142 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:08.170936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.171410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.171843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.172526 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.172978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.173513 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.186440 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb HTTP/1.1 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:26:08.195426 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.197068 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'e7c64516-610b-455f-92db-0dfdcb1144bb'} Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:08.198044 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.199671 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.201957 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:08.201957 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1d892f73-07d0-4a07-be4f-396c7934235a tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 404 len: 111 microversion: 2.1 time: 0.030990 Aug 07 01:26:08.201957 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 501/983] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:26:08 2022] DELETE /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:08.203568 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:08.204179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: e7c64516-610b-455f-92db-0dfdcb1144bb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:08.210530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.211270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.211698 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.212381 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.212828 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.213246 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.227062 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb HTTP/1.1 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:26:08.228731 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.230334 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'e7c64516-610b-455f-92db-0dfdcb1144bb'} Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:08.231248 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. Aug 07 01:26:08.232726 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:08.234158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance e7c64516-610b-455f-92db-0dfdcb1144bb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:08.234158 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-897ee152-c975-4984-b233-889769b1fa70 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb" status: 404 len: 111 microversion: 2.1 time: 0.030868 Aug 07 01:26:08.234158 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 483/984] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:08 2022] GET /compute/v2.1/servers/e7c64516-610b-455f-92db-0dfdcb1144bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:08.332285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:08.332922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:08.339581 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.340052 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.340480 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.341778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.342278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.342680 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.487562 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:08.495124 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5bf43a11-73ee-4a3e-960c-5bd5dda7980f tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1318 microversion: 2.1 time: 0.166827 Aug 07 01:26:08.495675 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 502/985] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:08 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:09.501074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:09.501570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:09.507936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.508413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.508845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.509526 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.510010 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.510433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.516467 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:09.517071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:09.523508 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.524007 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.524181 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.524438 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.525148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.525597 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 HTTP/1.1 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:26:09.525718 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.527312 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'bd406a7d-ec74-4def-981c-72d0d5d609d0'} Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:09.529326 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.530849 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.534119 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.534268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:09.534268 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5929c277-c2b0-4354-8b46-8f4878f9c1d4 tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 404 len: 111 microversion: 2.1 time: 0.030087 Aug 07 01:26:09.534268 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 484/986] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:26:09 2022] DELETE /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:09.535836 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:09.536441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] [instance: bd406a7d-ec74-4def-981c-72d0d5d609d0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:09.542158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.542636 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.543067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.544462 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:09.544846 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:09.545265 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:09.558422 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] HTTP exception thrown: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Request method failure captured: Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 HTTP/1.1 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKW5xgEumfQ-fvxg-8YjBHsecrs3lQ_hbMyNBJbJIDiE4yfnlak0AhSOlicwf5Ahs01a20V6mBOjGE_T1stFBdERdHv0jHA5bn7_1EBLc70RYXALgGwP7RG7aK019Ri152DCGAqu5T4vPW39rJ9xqhi2n0oKCMBcWIRG_6l09N0Klo Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:26:09.560140 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/440652d4d24d4a34985625be49c12a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/440652d4d24d4a34985625be49c12a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_440652d4d24d4a34985625be49c12a70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 440652d4d24d4a34985625be49c12a70 Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1793598954 Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 4c8389683e844b989fe5cbe779327933 Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-1793598954-project Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.562568 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'bd406a7d-ec74-4def-981c-72d0d5d609d0'} Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:09.563385 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. Aug 07 01:26:09.564567 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:26:09.566763 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] Returning 404 to user: Instance bd406a7d-ec74-4def-981c-72d0d5d609d0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:09.566763 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5f8536e9-6a74-46b7-9f7c-f7075abe2dde tempest-AttachVolumeTestJSON-1793598954 tempest-AttachVolumeTestJSON-1793598954-project] 10.222.0.36 "GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0" status: 404 len: 111 microversion: 2.1 time: 0.029315 Aug 07 01:26:09.566763 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 485/987] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:09 2022] GET /compute/v2.1/servers/bd406a7d-ec74-4def-981c-72d0d5d609d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:09.661361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:09.669672 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-663863f9-1d4c-4f08-88b4-c6a316b60813 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1507 microversion: 2.1 time: 0.156411 Aug 07 01:26:09.670526 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 503/988] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:09 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:21.150132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:21.151430 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=48 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:21.297042 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-76ebc371-95fa-4bc6-8b29-03467ac99e6f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: .version_select at 0x7fb7d0c94160>, body: {"keypair": {"name": "tempest-keypair-1328367492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbU576m3mZ9HEN8lS4eOYuf3DogD+2eAFQkPtyO/HbInxh4UQllkElpwRkKCZMtO+sDWwKOIklhZk9eS5mMin821yA9KhpdCWLCYUzp2wstimQod6eb0VhwGU3qiu9j9A=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:21.312674 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-76ebc371-95fa-4bc6-8b29-03467ac99e6f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:21.316478 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-76ebc371-95fa-4bc6-8b29-03467ac99e6f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:21.426776 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-76ebc371-95fa-4bc6-8b29-03467ac99e6f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.282220 Aug 07 01:26:21.427376 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 486/989] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:26:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:24.251031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-669847208", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91170ab7-2045-48e1-96f7-b144ccdd6c44"}], "security_groups": [{"name": "tempest-securitygroup--1835837521"}], "key_name": "tempest-keypair-1328367492", "user_data": "}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:24.259497 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:24.260175 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=17 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:24.360234 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.network.neutron [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] validate_networks() for [('91170ab7-2045-48e1-96f7-b144ccdd6c44', None, None, None, None, None)] {{(pid=118310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:24.736882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:24.737329 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image limits 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:24.737793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:24.738223 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image pref 0:0:0 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:24.738626 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.virt.hardware [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:24.747838 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.748315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.748740 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.749453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.749924 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.750344 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.767776 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:24.771772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:24.782261 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Going to run 1 instances... {{(pid=118310) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:24.784462 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:25.003296 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f49129a5-b77d-4395-a633-763463c1094e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.753877 Aug 07 01:26:25.004309 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 504/990] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:26:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:26:25.016392 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c9c4af0-7fd3-4d84-900e-b7f69ccee2c3 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:25.017267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c9c4af0-7fd3-4d84-900e-b7f69ccee2c3 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:25.079841 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6c9c4af0-7fd3-4d84-900e-b7f69ccee2c3 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:25.088168 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c9c4af0-7fd3-4d84-900e-b7f69ccee2c3 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1241 microversion: 2.1 time: 0.076643 Aug 07 01:26:25.098110 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 487/991] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:25 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:26.109296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-554e0be5-1d89-4a33-8f91-6e53d3dd0db6 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:26.109937 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-554e0be5-1d89-4a33-8f91-6e53d3dd0db6 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:26.162765 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-554e0be5-1d89-4a33-8f91-6e53d3dd0db6 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:26.169487 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-554e0be5-1d89-4a33-8f91-6e53d3dd0db6 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1241 microversion: 2.1 time: 0.064871 Aug 07 01:26:26.170080 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 505/992] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:26 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:27.190137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:27.190747 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:27.197034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:27.197515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:27.197974 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:27.198663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:27.199108 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:27.199530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:27.268753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:27.276335 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c1e41955-7983-4155-8c8c-7ff01a2abad5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1245 microversion: 2.1 time: 0.090370 Aug 07 01:26:27.276899 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 488/993] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:27 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:28.298647 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:28.299192 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:28.306100 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.306597 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.307025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.307704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.308149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.308568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.369544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:28.376952 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-357c5415-5447-4bbf-8909-984cfb74d50b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1311 microversion: 2.1 time: 0.083142 Aug 07 01:26:28.377515 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 506/994] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:28 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:28.415671 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f31b0c-0f25-4e24-8ee8-46a97a42f90c", "device": "/dev/sdb"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:28.419130 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:28.426317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.426798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.427227 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.428020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.428464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.428878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:29.343569 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-acd1cd7d-0797-437b-ae5a-5b9369f24e41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "POST /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932708 Aug 07 01:26:29.344195 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 489/995] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:26:28 2022] POST /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:29.403749 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:29.404519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:29.411090 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:29.411568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:29.412000 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:29.412700 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:29.413201 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:29.413629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:29.554770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:29.562164 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1fa421e5-ba18-4dec-b578-834ce6d9eb89 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.162219 Aug 07 01:26:29.562729 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 507/996] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:29 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:29.913241 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9bc327-3bea-4b44-abfd-6b0d0fc131c0", "tag": "e6621658-1a9d-48d3-9fee-503a50102793"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:29.923697 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:29.924175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:29.924625 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:29.935454 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] Creating event network-changed:e6621658-1a9d-48d3-9fee-503a50102793 for instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 on hv-cinder-maste Aug 07 01:26:29.940326 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-48ecf776-9945-4b74-abff-063119e8c06f req-97171243-1ee2-4a77-84bb-3a20b5fc98af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031885 Aug 07 01:26:29.940925 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 490/997] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:30.593563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:30.594203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:30.600582 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:30.601063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:30.601501 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:30.602214 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:30.602669 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:30.603094 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:30.737364 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:30.745054 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-ce7cf4c0-da58-4810-bc5b-49a8849b30ff tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.155341 Aug 07 01:26:30.750213 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 508/998] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:30 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:31.768434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:31.769052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:31.775110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.775592 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.776023 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.776709 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.777158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.777578 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.921743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:31.921743 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6bfbf8fc-27c7-4201-8f83-1c6af2c760a2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.154504 Aug 07 01:26:31.921743 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 491/999] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:31 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:32.938235 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:32.938790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:32.944796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.945280 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.945714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.946434 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.946888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.947311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.948103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0f31b0c-0f25-4e24-8ee8-46a97a42f90c", "create_info": {"type": "qcow2", "new_file": "volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32.vhdx", "snapshot_id": "f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32"}}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:32.956982 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=118310) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 07 01:26:32.957432 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.957949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.958376 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.996627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.997115 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.997577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:33.021596 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-d7414607-ea48-4e58-b84b-af755d43dbe6 req-4c504be3-d946-412e-b248-0baf2e3a0787 admin admin] 10.222.0.45 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.129178 Aug 07 01:26:33.022384 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 509/1000] 10.222.0.45 () {64 vars in 1326 bytes} [Sun Aug 7 01:26:32 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:26:33.076589 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:33.083990 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2908fc6c-4452-483c-9856-1d80530fb707 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.150133 Aug 07 01:26:33.084561 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 492/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:32 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:34.106296 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:34.107644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:34.114298 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:34.114772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:34.115231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:34.115908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:34.116369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:34.116787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:34.250579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:34.258006 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a90bc921-45eb-4d7e-923c-bd1ca6378b6a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.155908 Aug 07 01:26:34.258578 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 510/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:34 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:35.277905 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:35.278416 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:35.280798 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:35.285538 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:35.286054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:35.286493 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:35.287187 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:35.287641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:35.288063 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:35.416473 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:35.424369 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98ee62a5-82f6-4195-8e0f-630445795469 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.150431 Aug 07 01:26:35.424936 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 493/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:35 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:36.445741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:36.446373 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:36.448978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=8 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:36.454622 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.455102 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.455535 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.456221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.456665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.457086 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.593537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:36.601548 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-503ffe00-43c1-4b61-8cad-14ab850e828a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.159691 Aug 07 01:26:36.604509 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 511/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:36 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:37.623082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:37.623696 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:37.630251 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.630738 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.631173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.631865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.632317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.632739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.766941 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:37.774640 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-edd94e36-3e72-4037-8e21-eedd53e51031 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.155694 Aug 07 01:26:37.775209 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 494/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:37 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:38.759708 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9bc327-3bea-4b44-abfd-6b0d0fc131c0", "name": "network-vif-plugged", "status": "completed", "tag": "e6621658-1a9d-48d3-9fee-503a50102793"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:38.771330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.771815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.772372 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.785570 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] Creating event network-vif-plugged:e6621658-1a9d-48d3-9fee-503a50102793 for instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 on hv-cinder-maste Aug 07 01:26:38.790482 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-492b4d13-4196-4bc9-a4b5-ac02b5d0768e req-20525a33-7815-422d-8a3f-5a728fa02b7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034859 Aug 07 01:26:38.791256 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 512/1006] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:38.798773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.798773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.804093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.804584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.805021 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.805716 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.806197 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.806755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.942995 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.950568 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-994b2d22-8201-470f-9464-6da393d8cc7d tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.158659 Aug 07 01:26:38.951140 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 495/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:38 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:39.444968 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0f31b0c-0f25-4e24-8ee8-46a97a42f90c", "create_info": {"type": "qcow2", "new_file": "volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b.vhdx", "snapshot_id": "7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b"}}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:39.448212 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.448686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.449114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.457724 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.458224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.458649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.471371 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-e2e09164-61b6-4c30-8bc0-5713274bcaf9 req-6a795dd2-c4b6-4759-a439-4ce3501cbc3f admin admin] 10.222.0.45 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.076177 Aug 07 01:26:39.474567 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 513/1008] 10.222.0.45 () {64 vars in 1326 bytes} [Sun Aug 7 01:26:39 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:26:39.972050 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.972647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.979454 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.980109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.980357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.981065 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.981515 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.981964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.111435 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.118866 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5fba9faf-50da-4a0a-a039-63454d3fcf48 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.151518 Aug 07 01:26:40.119441 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 496/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:41.140512 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:41.141225 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:41.147999 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.148484 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.148925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.149620 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.150098 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.150536 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.284748 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.292241 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-db1833a9-3f22-46db-be62-687299236567 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1367 microversion: 2.1 time: 0.156669 Aug 07 01:26:41.292836 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 514/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:41 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:42.312993 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:42.313552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:42.320004 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.320485 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.320917 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.321603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.322093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.322516 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.454014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.462245 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9016fd22-f068-4b86-afb9-103d39b80734 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1556 microversion: 2.1 time: 0.153173 Aug 07 01:26:42.462837 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 497/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:42 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:42.483331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:42.486671 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:42.490949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.491420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.491844 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.492557 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.493006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.493419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.570503 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-420216cb-1d12-46e3-8474-1288b3753b2c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090963 Aug 07 01:26:42.571121 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 515/1012] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:26:42 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:26:43.790508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9bc327-3bea-4b44-abfd-6b0d0fc131c0", "tag": "e6621658-1a9d-48d3-9fee-503a50102793"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:43.801584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.802855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.802855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.813758 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] Creating event network-changed:e6621658-1a9d-48d3-9fee-503a50102793 for instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 on hv-cinder-maste Aug 07 01:26:43.818933 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-44bb527a-7a1f-4258-bc67-6e7a819afd8c req-f804747a-05e3-4a4b-95af-1ac181919f40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032423 Aug 07 01:26:43.819711 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 498/1013] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:45.971205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0f31b0c-0f25-4e24-8ee8-46a97a42f90c", "create_info": {"type": "qcow2", "new_file": "volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.cc230e2a-213b-4b68-b983-5d46fafba965.vhdx", "snapshot_id": "cc230e2a-213b-4b68-b983-5d46fafba965"}}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:45.974639 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.975157 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.975578 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.983824 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.984293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.984715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.999166 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-47deb2b0-e3ca-4ccc-bbda-20221e83b976 req-2413f69a-4a04-449c-b8e6-f84b9350dc79 admin admin] 10.222.0.45 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.078010 Aug 07 01:26:45.999754 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 516/1014] 10.222.0.45 () {64 vars in 1326 bytes} [Sun Aug 7 01:26:45 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:26:49.788796 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:49.797148 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a5e386-8ce3-4f54-95b2-9e719a5b2107(cell1) {{(pid=118307) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 07 01:26:49.797607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.798110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.798794 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.833213 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.833659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.834139 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.857656 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-3338750b-d6d2-497f-b8d8-a2843549c521 req-3f8c6824-a310-4b5b-b5e3-6d8ade14cbf1 admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.121268 Aug 07 01:26:49.858269 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 499/1015] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:26:49 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.f4e6afb9-04a7-4ac1-bcb5-a56a26abbd32.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:26:54.081799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:54.127559 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:54.130751 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:54.131226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:54.131764 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:54.140221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:54.140685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:54.141110 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:54.154698 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-41452249-02de-445a-b860-2e54e343e456 req-3d6d87a1-c485-449e-a23c-781c5c6976fa admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/cc230e2a-213b-4b68-b983-5d46fafba965?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.cc230e2a-213b-4b68-b983-5d46fafba965.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077932 Aug 07 01:26:54.155265 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 517/1016] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:26:54 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/cc230e2a-213b-4b68-b983-5d46fafba965?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.cc230e2a-213b-4b68-b983-5d46fafba965.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:26:58.400501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:58.403699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:58.404179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:58.404775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:58.413615 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:58.414115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:58.414544 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:58.416291 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:58.429437 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-db9031e4-0344-4edb-8dcd-d5286953e7ea req-58e53264-1102-4817-bc50-cd73cf1f4518 admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079106 Aug 07 01:26:58.430257 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 500/1017] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:26:58 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b?delete_info=%7B%22file_to_merge%22:%20%22volume-a0f31b0c-0f25-4e24-8ee8-46a97a42f90c.7fb72f7f-7f42-4ac3-a3dd-ef7b6adefd7b.vhdx%22,%20%22volume_id%22:%20%22a0f31b0c-0f25-4e24-8ee8-46a97a42f90c%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:00.527491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:00.529769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:00.537063 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.537570 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.538042 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.538741 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.539200 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.539629 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.543494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=53 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:00.570435 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-608f2804-ebd6-4650-a664-d1094a6a1d08 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047119 Aug 07 01:27:00.570928 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 518/1018] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Aug 7 01:27:00 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:00.634580 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:00.639302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:00.639888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:00.646695 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.664926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.664926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.664926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.664926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.665779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.675044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:00.964039 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0bf95f7b-280d-4fe8-8253-add17d140188 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 204 len: 0 microversion: 2.20 time: 0.330401 Aug 07 01:27:00.964859 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 501/1019] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Aug 7 01:27:00 2022] DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:27:00.973977 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:00.974712 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:00.981166 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.981735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.982359 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.983071 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.983550 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.983980 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:01.172993 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:01.181016 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:01.182577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:01.190221 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-1967fd47-a7a2-48b6-b48d-bc0f1d615c49 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.214362 Aug 07 01:27:01.190221 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 519/1020] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:00 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:02.208513 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:02.209898 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:02.216670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.217155 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.217590 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.218322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.218778 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.219198 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.381120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:02.381672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:02.388046 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.388529 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.388960 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.389704 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.390191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.390616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.417649 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.425316 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.426864 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.428040 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4446f219-f220-4b58-b24b-34250ee57697 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.224626 Aug 07 01:27:02.428850 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 502/1021] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:02 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:02.475530 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lazy-loading 'services' on Instance uuid 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:27:02.694641 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b3c1fd10-5aef-4ab2-80f9-e88d7f08f40b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048/os-volume_attachments/a0f31b0c-0f25-4e24-8ee8-46a97a42f90c" status: 202 len: 0 microversion: 2.1 time: 0.317127 Aug 07 01:27:02.695251 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 520/1022] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:27:02 2022] DELETE /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048/os-volume_attachments/a0f31b0c-0f25-4e24-8ee8-46a97a42f90c => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:03.453574 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:03.454162 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:03.460661 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.461141 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.461572 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.462532 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.462979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.463439 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.653193 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.662060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.663664 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.664820 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-465cf496-d19a-4c02-990b-6e65f0a0bff5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1724 microversion: 2.20 time: 0.215286 Aug 07 01:27:03.665385 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 503/1023] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:03 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:04.091739 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02c941d-57b1-4a65-af79-f6a8dde18c55", "name": "network-vif-deleted", "tag": "11f6a608-6253-4df9-95e3-2e91631c8077"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:04.101854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.102424 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.102930 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.114571 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] Creating event network-vif-deleted:11f6a608-6253-4df9-95e3-2e91631c8077 for instance e02c941d-57b1-4a65-af79-f6a8dde18c55 on hv-cinder-maste Aug 07 01:27:04.120606 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-004cfe2c-6baa-416f-bbe3-4e29556cb605 req-877ee339-bca1-40c2-9416-64d12123a1db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Aug 07 01:27:04.121483 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 521/1024] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:04.687800 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:04.689128 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:04.695612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.696093 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.696520 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.697241 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.697696 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.698231 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.731147 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.731643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.732074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.732518 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lazy-loading 'fault' on Instance uuid e02c941d-57b1-4a65-af79-f6a8dde18c55 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:27:04.773961 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.782626 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.784137 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '598402f6609c422cbcc0dd0bfae53430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785d30930ee41d88a31ff0760f8d699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.785564 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d801657a-3398-4c60-85f8-05c3ab565da5 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 200 len: 1371 microversion: 2.20 time: 0.101783 Aug 07 01:27:04.786157 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 504/1025] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:04 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:04.884654 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:04.885241 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:04.887232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=10 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:04.892354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.896401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.896401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.896401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.896401 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.896762 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.922357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:05.243251 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-9ff3e7d7-1d69-4e47-aa8d-cecfa305c708 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 204 len: 0 microversion: 2.1 time: 0.362521 Aug 07 01:27:05.243954 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 522/1026] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:27:04 2022] DELETE /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:05.252767 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:05.253408 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:05.259429 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.259915 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.260347 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.261053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.261502 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.261968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.395790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:05.403210 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-31bd4ed5-f501-454c-9b0e-f8e7aa4eb1ce tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1513 microversion: 2.1 time: 0.154948 Aug 07 01:27:05.403767 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 505/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:05 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:05.809191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:05.809910 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:05.816087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.816570 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.817006 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.817689 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.818168 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.818592 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.832153 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 HTTP/1.1 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:27:05.833756 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:05.835447 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'e02c941d-57b1-4a65-af79-f6a8dde18c55'} Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:05.836310 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:05.838114 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:05.839406 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:05.839406 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d8a5c5e2-0871-4224-aacb-1489615d07b4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 404 len: 111 microversion: 2.20 time: 0.030246 Aug 07 01:27:05.839406 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 523/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:05 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:05.844355 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a00b44b0-4e00-4e97-bd8f-523a34c787d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '.version_select at 0x7fb7d0c85c10>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:05.918252 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a00b44b0-4e00-4e97-bd8f-523a34c787d4 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665357237" status: 204 len: 0 microversion: 2.20 time: 0.077625 Aug 07 01:27:05.918849 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 506/1029] 10.222.0.36 () {60 vars in 1259 bytes} [Sun Aug 7 01:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665357237 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:27:06.424165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:06.424687 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:06.431573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:06.432054 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:06.432482 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:06.433169 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:06.433617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:06.434060 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:06.571410 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:06.579751 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c9ee305e-fe37-4681-9b6e-79229bb7f1f6 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1513 microversion: 2.1 time: 0.159479 Aug 07 01:27:06.580341 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 524/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:06 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:07.601423 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:07.602105 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:07.608959 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:07.609334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:07.609769 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:07.610481 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:07.610931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:07.611755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:07.744006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:07.747518 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1e0784ef-052b-4913-a999-26cb53beac23 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1513 microversion: 2.1 time: 0.150516 Aug 07 01:27:07.748086 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 507/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:07 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:07.996291 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:07.996773 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.003617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.004090 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.004520 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.005193 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.005700 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.006165 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.019789 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 HTTP/1.1 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:27:08.021599 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.023409 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'e02c941d-57b1-4a65-af79-f6a8dde18c55'} Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:08.024337 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.025898 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.028379 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:08.029216 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4b719266-c1cd-4f52-9378-9d249dafa493 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 404 len: 111 microversion: 2.20 time: 0.036794 Aug 07 01:27:08.029752 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 525/1032] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Aug 7 01:27:07 2022] DELETE /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:08.037873 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:08.038549 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: e02c941d-57b1-4a65-af79-f6a8dde18c55] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.044464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.044948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.045383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.046149 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.046611 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.047034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.060649 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 HTTP/1.1 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:27:08.062314 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.063967 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'e02c941d-57b1-4a65-af79-f6a8dde18c55'} Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:08.065446 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. Aug 07 01:27:08.066831 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:08.067911 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance e02c941d-57b1-4a65-af79-f6a8dde18c55 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:08.067911 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cf320402-4761-4790-bbb5-a7d661a25481 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55" status: 404 len: 111 microversion: 2.20 time: 0.029783 Aug 07 01:27:08.067911 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 508/1033] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:08 2022] GET /compute/v2.1/servers/e02c941d-57b1-4a65-af79-f6a8dde18c55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:08.769093 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:08.769709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.775760 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.776242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.776677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.777418 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.777908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.778337 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.910665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:08.918172 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-52805f6d-9286-44f3-bdef-2abbb8c1ba4b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1513 microversion: 2.1 time: 0.153194 Aug 07 01:27:08.918732 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 526/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:08 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:09.305299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.305817 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.307766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:09.312937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.313420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.313877 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.315174 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.315559 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.315983 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.329330 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 HTTP/1.1 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:27:09.331552 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.333186 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '39ad4a4c-7d17-429f-a99a-50572de3a588'} Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:09.334088 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.335309 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.336564 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:09.336564 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c5bc4a6d-c282-4f7a-b829-3e0a65c9bdb6 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 404 len: 111 microversion: 2.20 time: 0.031567 Aug 07 01:27:09.336564 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 509/1035] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Aug 7 01:27:09 2022] DELETE /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:09.341780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.342498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] [instance: 39ad4a4c-7d17-429f-a99a-50572de3a588] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.349077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.349554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.350013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.350701 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.351144 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.351564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.366511 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] HTTP exception thrown: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Request method failure captured: Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 HTTP/1.1 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xKWi_P2MjkEPcJJphYgV_i0RT0Zn3qxCNAJzz2EyYmMvfDmviOUgrRATVK65yy08FR42xrqUg52VQHv8BxxcKmWDkPNSD6pjvv5iddMBOG9--D-wjl6WBi27wBoz02fdkFGCAnh39LX-wZdMbmPmaHSxB6SrlJNDvFuUp_QhML_KR0 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:27:09.368020 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6785d30930ee41d88a31ff0760f8d699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6785d30930ee41d88a31ff0760f8d699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 6785d30930ee41d88a31ff0760f8d699 Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1910653144 Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 598402f6609c422cbcc0dd0bfae53430 Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1910653144-project Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.370117 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '39ad4a4c-7d17-429f-a99a-50572de3a588'} Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:09.371084 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. Aug 07 01:27:09.372559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:09.373982 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] Returning 404 to user: Instance 39ad4a4c-7d17-429f-a99a-50572de3a588 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:09.373982 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c1cb8bf9-f088-4dd9-9d3e-478c382bd060 tempest-AttachVolumeShelveTestJSON-1910653144 tempest-AttachVolumeShelveTestJSON-1910653144-project] 10.222.0.36 "GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588" status: 404 len: 111 microversion: 2.20 time: 0.031657 Aug 07 01:27:09.373982 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 527/1036] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:09 2022] GET /compute/v2.1/servers/39ad4a4c-7d17-429f-a99a-50572de3a588 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:09.938788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.939926 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.946257 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.946737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.947165 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.947853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.948300 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.948717 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.119685 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:10.128943 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a242da51-866b-42fc-957f-3254e6f009c3 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1513 microversion: 2.1 time: 0.193695 Aug 07 01:27:10.142386 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 510/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:09 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:10.659986 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a089d8c-2a57-4ee6-83db-b80a4cc1d048", "name": "network-vif-deleted", "tag": "7291d552-4bd7-4ffb-90bf-3a1d0a5064ee"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:10.669942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:10.671271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:10.671271 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.683833 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] Creating event network-vif-deleted:7291d552-4bd7-4ffb-90bf-3a1d0a5064ee for instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 on hv-cinder-maste Aug 07 01:27:10.688788 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-e13c1ead-c6d9-4582-9e81-1fa99fb4317b req-e9c86cee-63a6-4aaf-9f00-117b62ee9a9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Aug 07 01:27:10.689800 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 528/1038] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:11.151485 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:11.152775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:11.161060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:11.164909 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:11.164909 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:11.164909 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:11.164909 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:11.165305 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:11.198580 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:11.199073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:11.199512 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:11.199966 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lazy-loading 'fault' on Instance uuid 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:27:11.257553 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:11.266959 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2ff427bd-eb14-4a64-97bb-242304a2c79b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 200 len: 1308 microversion: 2.1 time: 0.119211 Aug 07 01:27:11.281153 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 511/1039] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:11 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:12.291288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:12.292124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: 5a089d8c-2a57-4ee6-83db-b80a4cc1d048] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:12.299494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.299984 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.300419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.301126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.302447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.303246 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.319872 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] HTTP exception thrown: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Request method failure captured: Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 HTTP/1.1 Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xSaWtsgN7WnhZ2qqPSFjzspBdMv8UP3N8-aSm04z6IALSi4UeZDPvpEVkgJ4MQ-4Mfu3MH1sSQLM6o5tX5eYOwLNX6gTRdLWg10_xWoeg-QH9NxoDIfmtSR3X90Bhh59ne9b7HmFcrPYYUj_0BF_O9bKOO5Vt_Q34niMtVGI2EiCsk Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 6692544b38264b1c94104e234259848b Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:27:12.321579 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6692544b38264b1c94104e234259848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6692544b38264b1c94104e234259848b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6692544b38264b1c94104e234259848b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6692544b38264b1c94104e234259848b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 6692544b38264b1c94104e234259848b Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-VolumesSnapshotTestJSON-1932743077-project Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: 7dbfda28a57647f1955e38acf410d18f Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-VolumesSnapshotTestJSON-1932743077-project Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. Aug 07 01:27:12.323372 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '5a089d8c-2a57-4ee6-83db-b80a4cc1d048'} Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:12.324360 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. Aug 07 01:27:12.330755 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:27:12.332617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Returning 404 to user: Instance 5a089d8c-2a57-4ee6-83db-b80a4cc1d048 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:12.332617 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a4d656ff-d9e3-4fa6-9ede-4064ae24f825 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048" status: 404 len: 111 microversion: 2.1 time: 0.037694 Aug 07 01:27:12.332617 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 529/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:12 2022] GET /compute/v2.1/servers/5a089d8c-2a57-4ee6-83db-b80a4cc1d048 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:27:16.695039 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-40300570", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "networks": [{"uuid": "f9d38288-4ed5-48ce-9f18-6a2665f4cad7"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:16.749311 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] validate_networks() for [('f9d38288-4ed5-48ce-9f18-6a2665f4cad7', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:17.121967 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:17.122389 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:17.122859 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:17.123268 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:17.123677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:17.133372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.137293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.137293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.137293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.137293 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.137691 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.152737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Getting quotas for project 6692544b38264b1c94104e234259848b. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:17.156641 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Getting quotas for user 7dbfda28a57647f1955e38acf410d18f and project 6692544b38264b1c94104e234259848b. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:17.168374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:17.170557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:17.268864 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7661f0e0-dcfe-4510-b709-aa622b27b532 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577183 Aug 07 01:27:17.271038 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 512/1041] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:17.285116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3734d721-e338-4f69-9e6b-6def768cafc7 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.285734 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3734d721-e338-4f69-9e6b-6def768cafc7 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:17.342069 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3734d721-e338-4f69-9e6b-6def768cafc7 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.349615 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3734d721-e338-4f69-9e6b-6def768cafc7 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1217 microversion: 2.1 time: 0.069236 Aug 07 01:27:17.350219 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 530/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:18.370322 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:18.372053 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:18.378275 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.379084 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.379525 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.380223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.380672 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.381109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.446398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:18.454326 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-84fb56c2-fda5-4f28-910e-f86bc70519aa tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1221 microversion: 2.1 time: 0.087763 Aug 07 01:27:18.454895 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 513/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:18 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:19.474806 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:19.476439 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:19.495604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.496096 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.497184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.497942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.498590 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.499017 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.572447 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.581770 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-17ec6c94-f8ab-40a0-8bed-a425fdb2cf5d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1287 microversion: 2.1 time: 0.110691 Aug 07 01:27:19.590187 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 531/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:19 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:20.608530 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:20.609129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:20.615772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:20.616260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:20.616696 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:20.617457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:20.617941 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:20.618367 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:20.824606 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:20.832581 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0a7eaf5c-72bc-4c1b-9a4e-4eb8cf2a955d tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.227959 Aug 07 01:27:20.833165 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 514/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:20 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:21.262527 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd88e2bd-36b9-4248-a3ef-659a007bc6f6", "tag": "93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:21.282922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.282922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.282922 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.286036 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] Creating event network-changed:93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371 for instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 on hv-cinder-maste Aug 07 01:27:21.291924 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-bea04a0c-1ea7-4815-8703-336bc615c74b req-16afc3d7-0860-4a69-9a39-d0a5b361a74b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033208 Aug 07 01:27:21.292659 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 532/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:21.864217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:21.864825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:21.871632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.872134 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.872572 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.873278 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.873730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.874232 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:22.081121 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:22.089170 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-46e00b14-5b52-4363-b7e3-7f86bfb8d8f9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.229448 Aug 07 01:27:22.090105 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 515/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:21 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:23.112496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:23.113285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:23.119732 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.120330 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.120854 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:23.121617 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.122181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.122805 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:23.254486 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:23.261801 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-22ec7d62-8961-4f53-9cd9-6fb408e3bb32 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.154522 Aug 07 01:27:23.262399 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 533/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:23 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:24.282764 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:24.283312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:24.297354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.297354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.297354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.297354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.297879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.297879 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.427407 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:24.434759 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7fbae682-6bec-4001-9a00-a1aafc0bcf7e tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.155932 Aug 07 01:27:24.435322 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 516/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:24 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:25.455398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:25.456155 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:25.458349 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:25.463181 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.463656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.467420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.467420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.467420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.467420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.595554 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:25.603587 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-c25d8573-ecfc-4c60-88cd-a7b078716239 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.152144 Aug 07 01:27:25.604178 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 534/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:25 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:26.624195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.624805 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:26.631350 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.631829 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.632260 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.632947 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.633394 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.633813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.764060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.773024 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e0986f43-540c-499c-9a08-da63059d9bc9 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.152766 Aug 07 01:27:26.773823 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 517/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:26 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:27.793623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:27.794306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:27.796888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=2 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:27.802191 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.802676 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.803120 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.803831 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.804288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.804715 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.940227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:27.947963 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-15d746b0-073d-4d9b-a063-cc59e4316214 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.158170 Aug 07 01:27:27.948559 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 535/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:27 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:28.959878 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd88e2bd-36b9-4248-a3ef-659a007bc6f6", "name": "network-vif-plugged", "status": "completed", "tag": "93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:28.965058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:28.965744 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:28.968995 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:28.969607 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:28.971975 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.972448 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.973324 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.977270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.977466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:28.978304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.978757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.979466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.979902 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.980324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.992994 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] Creating event network-vif-plugged:93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371 for instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 on hv-cinder-maste Aug 07 01:27:28.998132 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-2b3a5db7-d312-4f80-970a-010f0fe20eb0 req-a5a59add-42f3-4ec2-8109-ffbad86ef1e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042459 Aug 07 01:27:28.998903 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 518/1053] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:29.121908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:29.130118 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e459511c-86bf-45bf-8285-9c27dce8c473 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.165300 Aug 07 01:27:29.130689 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 536/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:30.152335 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:30.153020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:30.161173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.161647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.162100 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.162925 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.163372 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.168336 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.301068 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:30.309071 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b8ab6a70-7a3d-4e72-8381-f9d8a8fff527 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1317 microversion: 2.1 time: 0.161701 Aug 07 01:27:30.309677 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 519/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:30 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:31.330632 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:31.331190 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:31.338630 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:31.339136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:31.339571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:31.340259 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:31.340709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:31.341133 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:31.346097 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:31.482117 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:31.490328 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-282bbdf3-0b68-4c29-8cfb-ac7693796d41 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1506 microversion: 2.1 time: 0.163559 Aug 07 01:27:31.494405 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 537/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:31 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:31.514088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63d2ccc6-dc76-45fa-b80a-c640b71c6e6b", "device": "/dev/sdb"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:31.517488 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:31.520192 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:31.525299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:31.525780 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:31.526231 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:31.526924 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:31.527390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:31.527792 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:32.355516 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ece721cd-e4ce-4e53-8982-041bcbd04dbb tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "POST /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845014 Aug 07 01:27:32.356152 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 520/1057] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:27:31 2022] POST /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:35.488900 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "63d2ccc6-dc76-45fa-b80a-c640b71c6e6b", "create_info": {"type": "qcow2", "new_file": "volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.d5f69ae1-7d36-43ba-87bb-9d39da73de3f.vhdx", "snapshot_id": "d5f69ae1-7d36-43ba-87bb-9d39da73de3f"}}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:35.490730 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:35.491208 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:35.491725 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:35.500489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:35.500954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:35.501384 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:35.515548 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-5adb1b99-b92e-4dd8-9b4c-8997d006f290 req-9a24366a-a2a9-46d3-8047-c38acbdc82ef admin admin] 10.222.0.45 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.149444 Aug 07 01:27:35.516136 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 538/1058] 10.222.0.45 () {64 vars in 1326 bytes} [Sun Aug 7 01:27:35 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:27:40.134900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "63d2ccc6-dc76-45fa-b80a-c640b71c6e6b", "create_info": {"type": "qcow2", "new_file": "volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826.vhdx", "snapshot_id": "3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:40.138301 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.139048 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.139532 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.151482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.151482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.151482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.162948 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-8e69af31-c1dd-4c62-8746-740c09b8bdb0 req-264afe29-c53c-4e40-a977-e7c786ec1a8c admin admin] 10.222.0.45 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.151566 Aug 07 01:27:40.163572 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 521/1059] 10.222.0.45 () {64 vars in 1326 bytes} [Sun Aug 7 01:27:40 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:27:43.875160 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=7 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:43.926433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:43.929568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.930070 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.930538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.939179 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.939647 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.940076 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.953062 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-c70bd3b5-c608-44c7-8902-fe85b6444b7a req-97eeab53-bf28-47b6-8a24-7b65da40fa4b admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082904 Aug 07 01:27:43.953719 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 539/1060] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:27:43 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.3b3bd91e-ef38-43ac-ba3a-8b9fd30e1826.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:48.101400 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:48.220366 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:48.224188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.224688 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.225208 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.234117 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.234592 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.235026 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.249306 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-513b602b-5147-4ef3-b8c7-ee371551d6f3 req-f529e9d8-28d0-4831-a3e8-6aed240154d3 admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f5bc3af6-ded3-4bf9-b1c1-70a14dbc8c05?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.f5bc3af6-ded3-4bf9-b1c1-70a14dbc8c05.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.148850 Aug 07 01:27:48.250065 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 522/1061] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:27:48 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f5bc3af6-ded3-4bf9-b1c1-70a14dbc8c05?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.f5bc3af6-ded3-4bf9-b1c1-70a14dbc8c05.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:27:52.543323 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.547636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.547636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.547636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.556064 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.556532 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.556976 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.570393 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-70a2f96e-79d9-42be-8c59-b167eb636b06 req-ecaedeb4-3071-48a8-8392-ae0d7318e2c7 admin admin] 10.222.0.45 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d5f69ae1-7d36-43ba-87bb-9d39da73de3f?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.d5f69ae1-7d36-43ba-87bb-9d39da73de3f.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.148642 Aug 07 01:27:52.570963 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 540/1062] 10.222.0.45 () {62 vars in 1800 bytes} [Sun Aug 7 01:27:52 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d5f69ae1-7d36-43ba-87bb-9d39da73de3f?delete_info=%7B%22file_to_merge%22:%20%22volume-63d2ccc6-dc76-45fa-b80a-c640b71c6e6b.d5f69ae1-7d36-43ba-87bb-9d39da73de3f.vhdx%22,%20%22volume_id%22:%20%2263d2ccc6-dc76-45fa-b80a-c640b71c6e6b%22%7D => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:56.401634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:56.402312 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:56.409596 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.410142 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.410643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.411352 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.411803 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.412281 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.493284 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lazy-loading 'services' on Instance uuid fd88e2bd-36b9-4248-a3ef-659a007bc6f6 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:27:56.687981 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d69689a6-319c-468b-9a25-8ee3133b1225 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6/os-volume_attachments/63d2ccc6-dc76-45fa-b80a-c640b71c6e6b" status: 202 len: 0 microversion: 2.1 time: 0.290414 Aug 07 01:27:56.688612 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 523/1063] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:27:56 2022] DELETE /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6/os-volume_attachments/63d2ccc6-dc76-45fa-b80a-c640b71c6e6b => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:58.868981 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:58.869563 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:58.875641 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.876124 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.876560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.877252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.877702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.878156 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.902588 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:59.141306 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.141914 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.145025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:59.152571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.153115 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.153557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.154320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.154788 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.155223 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.162697 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3d4cf86c-9976-42a4-9c15-0b77214ef241 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 204 len: 0 microversion: 2.1 time: 0.298848 Aug 07 01:27:59.163295 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 541/1064] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:27:58 2022] DELETE /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:59.171913 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.172603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.179802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.180283 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.180562 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b5e358dd-5556-4d7a-8ec2-3dcd00f8074c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/ips" status: 200 len: 148 microversion: 2.1 time: 0.043803 Aug 07 01:27:59.180716 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.181149 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 524/1065] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:27:59.181408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.181892 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.182318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.320031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.330487 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-bb770b20-33df-4d48-9046-a61186217ec4 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1512 microversion: 2.1 time: 0.162222 Aug 07 01:27:59.335307 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 542/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:00.353457 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:00.354140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:00.361220 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.361713 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.364948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.364948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.364948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.364948 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.502354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:00.511061 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b24eb12c-cd14-4337-83f5-438e8630a500 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1512 microversion: 2.1 time: 0.161518 Aug 07 01:28:00.511637 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 525/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:00 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:01.532509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:01.533253 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:01.540407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.540887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.541316 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.542195 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.542649 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.543075 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.674665 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.682220 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4ba0a9fe-308e-4910-81c9-d0cc740b4e21 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1512 microversion: 2.1 time: 0.153652 Aug 07 01:28:01.682799 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 543/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:01 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:02.346627 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b462405-a21f-4bdb-9d56-1ea5a42032ad"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:02.349042 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:02.355390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.355874 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.356309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.356991 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.357443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.357886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.361398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:02.704686 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:02.705322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:02.707921 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=6 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:02.712959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.713436 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.713886 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.714571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.715022 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.715446 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.850485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:02.857912 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f12858e8-c06b-4ac3-91bd-dd9a4f53f99b tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1512 microversion: 2.1 time: 0.157120 Aug 07 01:28:02.858476 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 544/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:02 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:03.879122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:03.880254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:03.887055 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.887539 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.887971 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.888664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.889114 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.889537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:04.189754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:04.197667 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-53224b8f-b686-4aa0-90bc-f0b8be570334 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1512 microversion: 2.1 time: 0.322578 Aug 07 01:28:04.198280 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 545/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:03 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:04.777778 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2b371f1b-840c-4e52-adee-c8cbfdeb38e0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.434891 Aug 07 01:28:04.778427 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 526/1071] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:28:02 2022] POST /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments => generated 194 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:05.212262 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd88e2bd-36b9-4248-a3ef-659a007bc6f6", "name": "network-vif-deleted", "tag": "93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:05.220808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:05.221528 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:05.222126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.222633 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.223148 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.227773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.228307 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.228739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.229428 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.229900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.230325 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.235359 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] Creating event network-vif-deleted:93ee8cb5-23a9-45f9-bfc7-6b1cf81c8371 for instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 on hv-cinder-maste Aug 07 01:28:05.240888 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-5f8b46a8-7f21-4880-8323-50c0d8e88297 req-0aa98888-ec4b-498a-a940-444ee58c08ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181959 Aug 07 01:28:05.241490 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 546/1072] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:05.300870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:05.308625 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-903eea40-6d4d-4280-8fd7-8df948098002 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1302 microversion: 2.1 time: 0.092540 Aug 07 01:28:05.309318 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 527/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:05 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:06.330775 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:06.331466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:06.338257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.338743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.340552 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.340552 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.340552 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.340885 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.344885 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:06.372025 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.372498 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.372926 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.373369 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lazy-loading 'fault' on Instance uuid fd88e2bd-36b9-4248-a3ef-659a007bc6f6 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:28:06.418318 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfda28a57647f1955e38acf410d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6692544b38264b1c94104e234259848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:06.426369 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e38789b1-6367-47d0-af11-5d1536b155a2 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 200 len: 1307 microversion: 2.1 time: 0.099585 Aug 07 01:28:06.427321 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 547/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:06 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:07.448737 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.449383 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] [instance: fd88e2bd-36b9-4248-a3ef-659a007bc6f6] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.455918 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.456402 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.457128 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.457853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.458310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.458739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.472652 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] HTTP exception thrown: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Request method failure captured: Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 HTTP/1.1 Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xSaWtsgN7WnhZ2qqPSFjzspBdMv8UP3N8-aSm04z6IALSi4UeZDPvpEVkgJ4MQ-4Mfu3MH1sSQLM6o5tX5eYOwLNX6gTRdLWg10_xWoeg-QH9NxoDIfmtSR3X90Bhh59ne9b7HmFcrPYYUj_0BF_O9bKOO5Vt_Q34niMtVGI2EiCsk Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 6692544b38264b1c94104e234259848b Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:28:07.474357 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6692544b38264b1c94104e234259848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6692544b38264b1c94104e234259848b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6692544b38264b1c94104e234259848b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6692544b38264b1c94104e234259848b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 6692544b38264b1c94104e234259848b Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1932743077 Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-VolumesSnapshotTestJSON-1932743077-project Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: 7dbfda28a57647f1955e38acf410d18f Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-VolumesSnapshotTestJSON-1932743077-project Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. Aug 07 01:28:07.476041 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'fd88e2bd-36b9-4248-a3ef-659a007bc6f6'} Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:07.476963 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. Aug 07 01:28:07.478710 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:28:07.480052 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] Returning 404 to user: Instance fd88e2bd-36b9-4248-a3ef-659a007bc6f6 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:07.480052 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47eaed21-fb5d-4d87-9288-e3c2ef916b24 tempest-VolumesSnapshotTestJSON-1932743077 tempest-VolumesSnapshotTestJSON-1932743077-project] 10.222.0.36 "GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6" status: 404 len: 111 microversion: 2.1 time: 0.030929 Aug 07 01:28:07.480052 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 528/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/fd88e2bd-36b9-4248-a3ef-659a007bc6f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:08.092485 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5e1c3ac4-faea-4ea4-9b9a-1b5eaf6ba1fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: .version_select at 0x7fb7d0213b80>, body: {"keypair": {"name": "tempest-keypair-370937461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTiOouxQPiiiECfiOFP4WJjYOblKgbHnvV67gJCemz4CfWiERl6V9ePDyVxFN+3y0AszGpINPcZ6zU0XPGOsPWO16+ZX1jbCkGFesjZ4sx/BAXgv1wmHakuMM5y45vUhw=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:08.109041 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-5e1c3ac4-faea-4ea4-9b9a-1b5eaf6ba1fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:08.112769 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-5e1c3ac4-faea-4ea4-9b9a-1b5eaf6ba1fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:08.249355 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5e1c3ac4-faea-4ea4-9b9a-1b5eaf6ba1fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160564 Aug 07 01:28:08.249917 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 548/1076] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:28:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:11.065935 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-664548069", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91170ab7-2045-48e1-96f7-b144ccdd6c44"}], "security_groups": [{"name": "tempest-securitygroup--304491239"}], "key_name": "tempest-keypair-370937461", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:11.170482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] validate_networks() for [('91170ab7-2045-48e1-96f7-b144ccdd6c44', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:11.635693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:28:11.635693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:28:11.635693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:28:11.635693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:28:11.635693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:28:11.643705 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.644500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.645175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.645964 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.646419 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.646845 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.664250 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:11.668222 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:11.679804 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:28:11.682274 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:28:11.885365 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-83c8fcf9-8bb9-428b-bef9-44d1d3370013 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.826450 Aug 07 01:28:11.890170 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 529/1077] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:28:11.898156 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-20bc8f41-34ef-4b90-8532-633ff93cb684 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:11.898772 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-20bc8f41-34ef-4b90-8532-633ff93cb684 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:11.955270 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-20bc8f41-34ef-4b90-8532-633ff93cb684 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.963512 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-20bc8f41-34ef-4b90-8532-633ff93cb684 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1240 microversion: 2.1 time: 0.070257 Aug 07 01:28:11.964072 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 549/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:11 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:12.984634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c4bd994-abc9-4653-9c91-221e3868a1f0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:12.985251 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4c4bd994-abc9-4653-9c91-221e3868a1f0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:13.040628 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-4c4bd994-abc9-4653-9c91-221e3868a1f0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.047315 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4c4bd994-abc9-4653-9c91-221e3868a1f0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1240 microversion: 2.1 time: 0.066595 Aug 07 01:28:13.047877 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 530/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:14.068677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:14.069288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:14.075954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.076445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.076933 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.077635 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.078147 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.078573 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.140008 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:14.147843 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3e328645-8ee6-4d4a-9859-d42594a64f34 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1244 microversion: 2.1 time: 0.083254 Aug 07 01:28:14.148414 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 550/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:14 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:15.171070 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:15.171743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:15.178401 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.178971 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.179413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.180131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.180613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.181034 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.289091 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.297644 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-880390f9-f0c4-43a3-b7ae-e809ffe72ce9 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1300 microversion: 2.1 time: 0.130629 Aug 07 01:28:15.298265 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 531/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:15 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.320357 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:16.327494 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.342916 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.343407 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.343845 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.344545 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.349125 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.349604 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.497475 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.505024 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f0f4b5a3-5467-42f7-9ed6-5575da7359c5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.188748 Aug 07 01:28:16.505578 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 551/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:16 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:17.295837 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a90fd7-deca-4c04-8ce2-57d629637fdb", "tag": "a0b750c0-59d6-466a-a055-6c4a91dbddc9"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:17.307083 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.307585 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.308188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.319571 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] Creating event network-changed:a0b750c0-59d6-466a-a055-6c4a91dbddc9 for instance f6a90fd7-deca-4c04-8ce2-57d629637fdb on hv-cinder-maste Aug 07 01:28:17.325017 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-4ec8ffd2-9a70-4597-9553-b04e9c808b75 req-6517c01d-785b-4ec3-aaf3-0c9fca7611ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033591 Aug 07 01:28:17.325361 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 532/1083] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:17.532994 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:17.533756 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.540594 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.541085 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.541525 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.542251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.542752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.543158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.676239 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.684294 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-2df8e901-5bd1-47e3-8ad8-2621c641c162 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.155447 Aug 07 01:28:17.684881 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 552/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:17 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:18.706783 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:18.711172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:18.711172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:18.715464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.715950 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.716414 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.717129 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.717586 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.718064 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.849341 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:18.857313 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c804892c-d66e-4ca4-bbd5-d69500ad1dae tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.155498 Aug 07 01:28:18.857894 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 533/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:18 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:19.878261 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:19.878862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:19.885250 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.885729 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.886189 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.886876 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.887324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.887744 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.023104 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:20.030758 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0dce2eff-8737-4b3e-af3d-ea43edd5d5cb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.156317 Aug 07 01:28:20.031362 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 553/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:19 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:21.051802 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:21.052420 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:21.059599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.061132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.061132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.061459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.061659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.062110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.202565 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.210213 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-09448540-2b82-41c8-99e7-b5ba6d7f50cd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.162373 Aug 07 01:28:21.221875 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 534/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:21 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:22.233222 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:22.233857 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.236252 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=6 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:22.240959 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.241433 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.242285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.242970 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.243419 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.243837 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.379518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.387402 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-63d322be-ab57-41fd-830a-cae92dc6e6cc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.158120 Aug 07 01:28:22.399218 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 554/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:22 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:23.408537 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:23.422570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.422570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:23.422570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:23.422570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.422570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.423166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.423166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.423166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.423166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.551943 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.560149 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-029691f1-8527-4d2d-ba59-6c2dbfd531ba tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.155527 Aug 07 01:28:23.560708 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 535/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:23 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:24.581158 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:24.581759 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:24.584177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:24.589019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.589524 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.589989 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.590770 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.591232 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.591651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.718868 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:24.726151 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa2a00cf-4705-4988-906e-00567392a436 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.148881 Aug 07 01:28:24.726716 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 555/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:24 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:25.234808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a90fd7-deca-4c04-8ce2-57d629637fdb", "name": "network-vif-plugged", "status": "completed", "tag": "a0b750c0-59d6-466a-a055-6c4a91dbddc9"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:25.252270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.252841 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.253273 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.265918 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] Creating event network-vif-plugged:a0b750c0-59d6-466a-a055-6c4a91dbddc9 for instance f6a90fd7-deca-4c04-8ce2-57d629637fdb on hv-cinder-maste Aug 07 01:28:25.271572 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-81c1877b-5681-41a8-8885-bf7499d277e4 req-11c22af1-769a-47c8-8408-f98026541596 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112414 Aug 07 01:28:25.273744 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 536/1091] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:25.746302 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:25.747207 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:25.753802 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.754368 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.754888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.755579 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.756031 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.756454 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.898293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.906697 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3379d0d1-ce0d-4a02-aaf4-c09edd02acdd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.164298 Aug 07 01:28:25.907256 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 556/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:25 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:26.928733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.929433 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.936459 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.936937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.937371 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.938089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.938541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.938966 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.069599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:27.077315 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a150a46b-0ce5-4273-ac7e-9df7268fd75a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1365 microversion: 2.1 time: 0.153313 Aug 07 01:28:27.077994 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 537/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:28.098138 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.098798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.105371 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.105883 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.106322 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.107221 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.107696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.108134 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.246122 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:28.254322 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-140fc340-f750-4c90-8c77-35298aadc78c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1555 microversion: 2.1 time: 0.160185 Aug 07 01:28:28.254890 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 557/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:28.274588 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.275095 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.282842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.283330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.283766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.284466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.285060 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.285369 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.364784 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-93e148dc-f387-4483-baa2-0e9073e0a3c1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093450 Aug 07 01:28:28.364923 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 538/1095] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:29.361116 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a90fd7-deca-4c04-8ce2-57d629637fdb", "tag": "a0b750c0-59d6-466a-a055-6c4a91dbddc9"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:29.370992 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.371465 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.371887 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.383406 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] Creating event network-changed:a0b750c0-59d6-466a-a055-6c4a91dbddc9 for instance f6a90fd7-deca-4c04-8ce2-57d629637fdb on hv-cinder-maste Aug 07 01:28:29.388412 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-ce5604fc-fc93-4f41-b676-b0c2b9c804cb req-1a3d979d-85c6-444b-bd19-7b0906ff623a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031660 Aug 07 01:28:29.388998 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 558/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:29:00.018655 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:29:00.019246 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:29:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:29:44.594098 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=11 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:44.594852 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:44.599036 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:44.599520 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.605395 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.610266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.610266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.610266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.610266 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.610604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.631518 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c5ef954f-6c9f-4096-b690-29c76b632cde tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/ips" status: 200 len: 150 microversion: 2.1 time: 0.039551 Aug 07 01:29:44.632087 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 539/1097] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:29:44 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:44.642564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=7 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:44.643416 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=57 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:44.647975 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b462405-a21f-4bdb-9d56-1ea5a42032ad"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:44.650560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.657227 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.657714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.658186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.658884 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.659342 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.659768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.737643 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: POST /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/os-volume_attachments HTTP/1.1 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 74 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:29:44.739576 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: {"volumeAttachment": {"volumeId": "2b462405-a21f-4bdb-9d56-1ea5a42032ad"}} Aug 07 01:29:44.741356 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'server_id': 'f6a90fd7-deca-4c04-8ce2-57d629637fdb', 'body': {'volumeAttachment': {'volumeId': '2b462405-a21f-4bdb-9d56-1ea5a42032ad'}}} Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:44.743028 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:44.744629 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 400 to user: Invalid volume: volume 2b462405-a21f-4bdb-9d56-1ea5a42032ad is already attached to instances: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3739836a-e59b-4dc7-b12e-ba45917d09d2 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100477 Aug 07 01:29:44.746173 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 559/1098] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:29:44 2022] POST /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:29:44.750106 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:44.750599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.757110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.758218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.758648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.759331 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.759780 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.760195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.784870 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:29:45.154883 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-587759da-7f0a-4f64-9f68-7c1581babb88 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 204 len: 0 microversion: 2.1 time: 0.408144 Aug 07 01:29:45.155623 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 540/1099] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:44 2022] DELETE /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:45.164353 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:45.165019 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:45.171027 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:45.171509 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:45.171943 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:45.172627 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:45.173067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:45.173506 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:45.307840 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:45.315258 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a7e5b3f4-af55-4bca-b2ee-e2c531a205fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1680 microversion: 2.1 time: 0.155369 Aug 07 01:29:45.315808 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 560/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:45 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:46.336772 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:46.337404 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:46.344006 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:46.344487 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:46.344917 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:46.345599 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:46.346072 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:46.346488 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:46.477131 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:46.484587 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3ac101e9-9fdf-46d4-8ea9-86f60240f091 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1680 microversion: 2.1 time: 0.152283 Aug 07 01:29:46.485153 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 541/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:46 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:47.506361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:47.507077 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:47.513219 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.513793 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.514257 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.514954 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.515412 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.515837 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.650938 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:47.658496 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-607c2126-752a-46ad-ba33-5e1913ff0934 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1680 microversion: 2.1 time: 0.156281 Aug 07 01:29:47.659048 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 561/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:47 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:47.998931 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a90fd7-deca-4c04-8ce2-57d629637fdb", "name": "network-vif-deleted", "tag": "a0b750c0-59d6-466a-a055-6c4a91dbddc9"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:48.015235 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.015699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.016132 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.029101 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] Creating event network-vif-deleted:a0b750c0-59d6-466a-a055-6c4a91dbddc9 for instance f6a90fd7-deca-4c04-8ce2-57d629637fdb on hv-cinder-maste Aug 07 01:29:48.034162 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-3fdc25cc-516e-48dc-9dd7-80d620f96208 req-2ef6eef3-6467-4710-8ba3-7c544e142388 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038863 Aug 07 01:29:48.035582 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 542/1103] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:48.680852 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:48.681400 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:48.687804 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.688294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.688728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.689420 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.689914 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.690325 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.721985 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.722465 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.722903 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.723348 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'fault' on Instance uuid f6a90fd7-deca-4c04-8ce2-57d629637fdb {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:48.765028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:48.772400 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-946e8a8a-afa0-4f17-9b7e-5b810067b843 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 200 len: 1330 microversion: 2.1 time: 0.096204 Aug 07 01:29:48.772999 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 562/1104] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:48 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:49.793860 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:49.794552 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:49.800812 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:49.801309 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:49.801735 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:49.802432 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:49.802876 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:49.803289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:49.816837 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb HTTP/1.1 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:29:49.818486 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:29:49.821122 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'f6a90fd7-deca-4c04-8ce2-57d629637fdb'} Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:49.822090 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:29:49.823599 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:29:49.824986 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:49.824986 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0e31a019-4358-430a-8d70-ba899af6376f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 404 len: 111 microversion: 2.1 time: 0.030753 Aug 07 01:29:49.824986 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 543/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:49 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:49.829528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f3c4b551-5fd3-49cc-bb3f-508ea4c0332a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '.version_select at 0x7fb7d55b7160>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:49.908859 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f3c4b551-5fd3-49cc-bb3f-508ea4c0332a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370937461" status: 202 len: 0 microversion: 2.1 time: 0.083098 Aug 07 01:29:49.909433 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 563/1106] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Aug 7 01:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370937461 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:29:50.686605 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:50.687099 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:50.692990 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.693468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.693929 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:50.695362 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.695706 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.696237 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:50.776566 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'services' on Instance uuid 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:50.987931 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b4f358b5-a01c-4481-95a1-a41ddb7ae03a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments/2b462405-a21f-4bdb-9d56-1ea5a42032ad" status: 202 len: 0 microversion: 2.1 time: 0.305048 Aug 07 01:29:50.992230 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 544/1107] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:29:50 2022] DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments/2b462405-a21f-4bdb-9d56-1ea5a42032ad => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:29:50.998277 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:51.000568 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:51.007350 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.007912 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.008408 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.009199 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.009733 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.010178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.039541 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-94903f78-c4f2-429d-9aa7-5b3d60e50c16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Aug 07 01:29:51.040135 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 564/1108] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:29:50 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:52.052754 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:52.055195 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:52.061581 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.062110 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.062557 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.063270 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.063813 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.064241 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.094600 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ea002619-192a-44a0-bf19-ea6c8ef2524f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046573 Aug 07 01:29:52.095084 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 545/1109] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:29:52 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:29:52.156415 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:52.156946 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:52.164186 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.164679 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.165144 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.165859 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.166306 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.166726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.191254 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:29:52.446511 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4a94dc97-3173-40ee-9cad-533d38116fca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 204 len: 0 microversion: 2.1 time: 0.294415 Aug 07 01:29:52.446996 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 565/1110] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:52 2022] DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:52.455189 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:52.455809 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:52.462831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.463317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.464020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.464711 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.465166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.465591 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.593937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:52.601560 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d5ec8f18-db30-45b7-8deb-861296770a3b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1680 microversion: 2.1 time: 0.150318 Aug 07 01:29:52.602159 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 546/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:52 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:53.623574 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:53.624265 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:53.630577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.631053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.631483 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.632164 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.632612 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.633033 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.760267 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:53.767768 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e086a807-16f5-4011-a599-fc16d481ffd0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1680 microversion: 2.1 time: 0.148394 Aug 07 01:29:53.768327 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 566/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:53 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:54.789055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:54.790308 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:54.796689 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.797172 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.797603 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.798317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.798773 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.799188 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.012057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:55.019462 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0d26cba5-5b31-4857-93f1-d01bc85448db tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1680 microversion: 2.1 time: 0.234379 Aug 07 01:29:55.020071 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 547/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:54 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:55.610535 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9bc327-3bea-4b44-abfd-6b0d0fc131c0", "name": "network-vif-deleted", "tag": "e6621658-1a9d-48d3-9fee-503a50102793"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:55.621564 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:55.622799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:55.622799 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.636691 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] Creating event network-vif-deleted:e6621658-1a9d-48d3-9fee-503a50102793 for instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 on hv-cinder-maste Aug 07 01:29:55.641501 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-587fd39f-258c-44ca-8410-0e8ed52afaf8 req-8dc0d67c-3bcf-417c-b7fd-16bd3eec65df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034915 Aug 07 01:29:55.642128 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 567/1114] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:56.041330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:56.042067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:56.048314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.048880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.049384 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.050181 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.050710 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.051410 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.083657 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.084044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.084480 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.084923 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'fault' on Instance uuid 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:56.126910 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.134546 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-93599c1a-0df2-4874-a75e-0c97f856052b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 200 len: 1331 microversion: 2.1 time: 0.097339 Aug 07 01:29:56.135440 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 548/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:56 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:57.157066 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:57.157790 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:57.163962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.164448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.164895 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.165712 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.166194 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.166621 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.180041 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 HTTP/1.1 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:29:57.181714 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:29:57.183328 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '5b9bc327-3bea-4b44-abfd-6b0d0fc131c0'} Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:57.184159 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:29:57.185559 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:29:57.186873 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:57.186873 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-04bcc02b-06e5-43d1-bd81-8b7a5ad63d25 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 404 len: 111 microversion: 2.1 time: 0.030779 Aug 07 01:29:57.186873 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 568/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:57 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:57.191994 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-143d833e-012a-4342-98cf-58a97d544d68 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '.version_select at 0x7fb7d18b0790>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:57.275353 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-143d833e-012a-4342-98cf-58a97d544d68 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328367492" status: 202 len: 0 microversion: 2.1 time: 0.086948 Aug 07 01:29:57.275847 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 549/1117] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Aug 7 01:29:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328367492 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:29:57.982823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a909a2b9-c4a5-47c6-a6a3-1ae4e025c98b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: .version_select at 0x7fb7d55b71f0>, body: {"keypair": {"name": "tempest-keypair-1515585192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9+l9FvB8TIRjhykUh0G85LyrbyHSALtgnpuUe8//kUVTQ3x1A+y2f4xUySsZaxglNppSJ4TptLJcWBRLkUrjXvEkgWdoUoSSOeghx3Q1ITLFXmlMKs5Dd+DHdIgG3cgQ=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:57.998644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-a909a2b9-c4a5-47c6-a6a3-1ae4e025c98b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:58.002403 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-a909a2b9-c4a5-47c6-a6a3-1ae4e025c98b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:58.075501 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a909a2b9-c4a5-47c6-a6a3-1ae4e025c98b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096652 Aug 07 01:29:58.076100 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 569/1118] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:29:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:00.248225 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1186618305", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91170ab7-2045-48e1-96f7-b144ccdd6c44"}], "security_groups": [{"name": "tempest-securitygroup--280352272"}], "key_name": "tempest-keypair-1515585192", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:00.351539 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] validate_networks() for [('91170ab7-2045-48e1-96f7-b144ccdd6c44', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:00.719608 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:00.720028 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:00.720501 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:00.720908 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:00.721318 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:00.730252 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.730734 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.731166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.731886 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.732339 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.732787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.749159 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:00.753074 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:00.764632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:00.766905 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:00.876200 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9467db95-867e-43c5-86d3-e2dd1627a584 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.632909 Aug 07 01:30:00.877179 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 550/1119] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:00.889115 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-8e82b188-a51a-47ea-ba5d-72a28f09cf6e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:00.889726 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-8e82b188-a51a-47ea-ba5d-72a28f09cf6e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:00.946685 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-8e82b188-a51a-47ea-ba5d-72a28f09cf6e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:00.955397 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-8e82b188-a51a-47ea-ba5d-72a28f09cf6e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1242 microversion: 2.1 time: 0.070100 Aug 07 01:30:00.956265 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 570/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:00 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:01.977714 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:01.979267 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:01.987634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.988173 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.988604 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.989541 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.990045 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.990464 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.056694 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.064383 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d0104e8-4ba1-4920-9e15-3378816e9bb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1246 microversion: 2.1 time: 0.091740 Aug 07 01:30:02.064989 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 551/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:01 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:03.086056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:03.086962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:03.094798 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.095299 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.095743 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.096453 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.096908 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.097335 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.161178 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:03.169976 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4334e824-a09e-40ab-9a1c-5d30e24cc1ed tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1312 microversion: 2.1 time: 0.088027 Aug 07 01:30:03.170562 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 571/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:03 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1312 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:04.191282 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:04.192041 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:04.199436 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.199919 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.200354 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.201702 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.202187 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.202613 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.413080 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.421518 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d45addda-f127-414a-a5fd-b7beea20c964 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.234112 Aug 07 01:30:04.422149 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 552/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:04 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:04.584571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1af330-75cf-4efa-8101-9e01fc37856e", "tag": "7018d35d-006e-4320-9e5c-0c2c1e4f0c80"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:04.594812 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.595290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.595719 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.607130 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] Creating event network-changed:7018d35d-006e-4320-9e5c-0c2c1e4f0c80 for instance 5e1af330-75cf-4efa-8101-9e01fc37856e on hv-cinder-maste Aug 07 01:30:04.612007 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-ca9b5d0b-a92b-4ba7-ba0a-cce39fee72f2 req-653239fa-90fb-4f65-a33f-38d39cbe878b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031246 Aug 07 01:30:04.612639 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 572/1124] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:05.442785 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.443450 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.450733 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.451775 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.452253 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.453158 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.453612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.454067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.586207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.593783 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8cfc3b5b-5e01-44f2-a8ab-2480c3827278 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.155194 Aug 07 01:30:05.594368 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 553/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:05 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:06.615950 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:06.616677 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:06.623177 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.623666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.624098 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.624787 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.625235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.625657 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.768955 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:06.772964 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-900a7568-0fa8-4082-8f1f-46e5a96317fd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.161873 Aug 07 01:30:06.773561 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 573/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:06 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:07.794999 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:07.795650 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:07.802468 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.803058 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.803511 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.804184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.804639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.805143 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.933715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:07.941168 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cb157791-7a96-47c0-9646-ce2ad0bc7c91 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.150079 Aug 07 01:30:07.941724 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 554/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:07 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:08.961635 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:08.962281 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:08.968969 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.969468 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.969920 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.970608 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.971050 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.971463 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.098987 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.107004 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a385cba8-963b-4976-8f8a-8ead39a9f23f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.149346 Aug 07 01:30:09.107564 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 574/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:08 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:10.128479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:10.129088 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:10.136302 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.136779 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.137210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.137912 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.138361 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.138782 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.279123 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.286990 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3bb8b5ed-253f-4c2e-b1f4-cd5fe2b2f027 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.162294 Aug 07 01:30:10.287575 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 555/1129] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:10 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:11.307422 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:11.308056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:11.310553 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=6 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:11.315459 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.315937 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.316367 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.317056 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.317502 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.317953 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.450728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.458142 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-4f39fa7b-23bd-479a-a21e-ccc45a314de0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.154666 Aug 07 01:30:11.458714 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 575/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:11 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:11.690103 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1af330-75cf-4efa-8101-9e01fc37856e", "name": "network-vif-plugged", "status": "completed", "tag": "7018d35d-006e-4320-9e5c-0c2c1e4f0c80"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:11.698997 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:11.699665 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:11.704020 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.707949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.707949 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.708677 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:11.716032 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] Creating event network-vif-plugged:7018d35d-006e-4320-9e5c-0c2c1e4f0c80 for instance 5e1af330-75cf-4efa-8101-9e01fc37856e on hv-cinder-maste Aug 07 01:30:11.721012 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-4a21e8da-2b0a-442c-8f7b-68d0386dd16d req-af3ad8ba-77ac-4ee4-a7b4-44c1232e1676 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Aug 07 01:30:11.721597 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 556/1131] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:12.479619 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.480250 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.486797 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.487511 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.487936 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.488615 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.489053 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.489471 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.618440 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:12.625966 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-044d3168-c588-4e29-afbb-5b988c90d53e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.150756 Aug 07 01:30:12.626544 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 576/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:13.650187 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.650892 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.658359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.658847 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.659283 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.660049 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.660503 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.660930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.794326 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:13.801649 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-75bbb313-61ba-4df0-991f-1ed50ac39e70 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1367 microversion: 2.1 time: 0.157979 Aug 07 01:30:13.802259 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 557/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:13 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.823251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.823855 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.826183 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:14.830842 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.831320 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.831754 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.832437 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.832888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.833324 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.836522 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:14.962445 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:14.970158 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-628332ce-813a-44e1-a48e-f84c0e26a58e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1557 microversion: 2.1 time: 0.151429 Aug 07 01:30:14.970727 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 577/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.991215 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.997715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.997715 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:15.001216 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.002491 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.002976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.003683 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.004138 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.004564 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.088734 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8ca4158a-a690-43c5-ada5-e53f3fbd7201 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097335 Aug 07 01:30:15.088734 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 558/1135] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:16.047815 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1af330-75cf-4efa-8101-9e01fc37856e", "tag": "7018d35d-006e-4320-9e5c-0c2c1e4f0c80"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:16.058448 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:16.058925 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:16.059388 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.072677 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] Creating event network-changed:7018d35d-006e-4320-9e5c-0c2c1e4f0c80 for instance 5e1af330-75cf-4efa-8101-9e01fc37856e on hv-cinder-maste Aug 07 01:30:16.077696 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-2f7b5247-edd8-4947-8e58-462762410590 req-181d9320-6ff9-40dd-a224-a3758d80b623 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034264 Aug 07 01:30:16.078519 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 578/1136] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:20.765483 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=10 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:20.881337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:20.881862 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:20.887719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.888199 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.888629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.889314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.889762 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.890218 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.913816 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-89109507-4cc5-44aa-bc7b-5b609ab2722f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/ips" status: 200 len: 150 microversion: 2.1 time: 0.150301 Aug 07 01:31:20.914388 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 559/1137] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:31:20 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/ips => generated 150 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:22.684103 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=7 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:22.689174 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d9d44e-4205-4277-9b2e-3707b941473e"}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:22.692386 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.698598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.699081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.699518 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.700205 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.700659 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.701106 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.544330 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-60ff7beb-4aac-4596-8978-3f15a456dc60 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862121 Aug 07 01:31:23.544930 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 579/1138] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:31:22 2022] POST /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:25.779079 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d9d44e-4205-4277-9b2e-3707b941473e"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:25.781498 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:25.788575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.789051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.789482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.790191 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.790643 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.791066 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.870319 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: POST /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments HTTP/1.1 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 74 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:31:25.872056 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: {"volumeAttachment": {"volumeId": "a0d9d44e-4205-4277-9b2e-3707b941473e"}} Aug 07 01:31:25.873777 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'server_id': '5e1af330-75cf-4efa-8101-9e01fc37856e', 'body': {'volumeAttachment': {'volumeId': 'a0d9d44e-4205-4277-9b2e-3707b941473e'}}} Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:31:25.874872 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:25.876144 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 400 to user: Invalid volume: volume a0d9d44e-4205-4277-9b2e-3707b941473e is already attached to instances: 5e1af330-75cf-4efa-8101-9e01fc37856e {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f0554c4a-527a-40ba-8228-dccf42077774 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098466 Aug 07 01:31:25.877653 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 560/1139] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:31:25 2022] POST /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:31:25.937636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:25.938235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:25.944275 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.944752 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.945180 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.945882 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.946331 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.946750 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.026696 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'services' on Instance uuid 5e1af330-75cf-4efa-8101-9e01fc37856e {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:31:26.225938 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-43a3d834-889c-4eed-9de0-88e10a974df8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments/a0d9d44e-4205-4277-9b2e-3707b941473e" status: 202 len: 0 microversion: 2.1 time: 0.292688 Aug 07 01:31:26.226449 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 580/1140] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:31:25 2022] DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments/a0d9d44e-4205-4277-9b2e-3707b941473e => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:26.235593 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:26.237849 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:26.244807 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.247631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.247631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.247631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.247631 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.248025 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.276202 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d35f34fb-ee5d-4d65-9911-205a1ae46bca tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 07 01:31:26.276806 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 561/1141] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:31:26 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:27.290672 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:27.293067 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:27.299293 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.299789 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.300231 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.300915 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.301361 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.301778 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.331465 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-e9d11e2c-d85e-4479-9fcc-ab8766b3da4f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Aug 07 01:31:27.332018 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 581/1142] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:31:27 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:28.343823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.346479 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.352807 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.353289 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.353723 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.354430 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.354875 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.355295 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.384281 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-97264181-05ec-421a-bfef-859d6bf82e97 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044638 Aug 07 01:31:28.384840 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 562/1143] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:31:28.447598 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.448121 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.454510 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.455489 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.455931 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.456647 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.457105 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.457537 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.483107 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:28.734734 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-3e87a6a5-44d1-42c3-b0dd-edd9b86b65ad tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 204 len: 0 microversion: 2.1 time: 0.291158 Aug 07 01:31:28.735317 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 582/1144] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:28 2022] DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:28.743540 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.747812 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.751073 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.751549 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.751976 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.752977 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.753452 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.753900 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.889446 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:28.903222 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-05d76af2-e42e-42ac-b878-d3c679a2db16 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1682 microversion: 2.1 time: 0.163441 Aug 07 01:31:28.909587 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 563/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:29.924538 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.925370 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.932081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.932558 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.932990 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.933666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.934187 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.934623 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.065956 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:30.073346 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-50001e2f-6f5e-4a55-8c94-e16e7ea70dea tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1682 microversion: 2.1 time: 0.153199 Aug 07 01:31:30.073926 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 583/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:29 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:31.095054 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.095721 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.102545 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.103024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.103449 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.104185 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.104634 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.105051 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.303471 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.311270 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0dd2e9b9-04e5-4a0c-bf8a-8e719d7bbd45 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1682 microversion: 2.1 time: 0.220024 Aug 07 01:31:31.311851 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 564/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:31.668428 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1af330-75cf-4efa-8101-9e01fc37856e", "name": "network-vif-deleted", "tag": "7018d35d-006e-4320-9e5c-0c2c1e4f0c80"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:31.679081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.679556 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.679978 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.691174 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] Creating event network-vif-deleted:7018d35d-006e-4320-9e5c-0c2c1e4f0c80 for instance 5e1af330-75cf-4efa-8101-9e01fc37856e on hv-cinder-maste Aug 07 01:31:31.696022 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-ec4957db-0ff3-4679-985f-55cce2a50d17 req-44dcaa77-7de9-4f1c-bf44-689d8e682c5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Aug 07 01:31:31.696749 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 584/1148] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:32.332614 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.333221 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:32.339586 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.340065 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.340500 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.341184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.341629 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.342078 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.374648 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.375286 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.375726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.376182 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'fault' on Instance uuid 5e1af330-75cf-4efa-8101-9e01fc37856e {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:31:32.420872 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.428822 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-13d8182f-44bb-416d-bb7c-6683ee37ddb8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 200 len: 1332 microversion: 2.1 time: 0.100613 Aug 07 01:31:32.439343 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 565/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:32 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:33.453230 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.453942 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.460087 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.460560 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.460990 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.461668 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.462149 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.462569 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.476187 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e HTTP/1.1 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:31:33.477780 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:31:33.479423 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '5e1af330-75cf-4efa-8101-9e01fc37856e'} Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:33.480264 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:31:33.481752 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.483131 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:33.483131 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-52e5c34d-8f5f-4079-86e7-93cad479697b tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 404 len: 111 microversion: 2.1 time: 0.030769 Aug 07 01:31:33.483131 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 585/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:33.488726 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e2f7f4c6-2f3c-412d-8db7-b538c90623dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '.version_select at 0x7fb7d0d14e50>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.592533 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e2f7f4c6-2f3c-412d-8db7-b538c90623dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515585192" status: 202 len: 0 microversion: 2.1 time: 0.108320 Aug 07 01:31:33.593102 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 566/1151] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Aug 7 01:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515585192 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:34.298226 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-beea14a3-5865-4fac-a8d8-7327d2637a85 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: .version_select at 0x7fb7d07fa9d0>, body: {"keypair": {"name": "tempest-keypair-945761289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlF5mjg/cbYl2pQQ0IEU8OcoRdIdThU+PmTTVyxmH/MmwQf5f0xm5GTeICCasIqwfr/EHSgmIff2zKNj6uC9sTI4HYzqVZ6O9axSzQNpDkhYBC/Zt5Hi1KsT9iWqbN6BA=="}} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:34.313682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-beea14a3-5865-4fac-a8d8-7327d2637a85 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:31:34.318366 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.quota [None req-beea14a3-5865-4fac-a8d8-7327d2637a85 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'key_pairs'} {{(pid=118310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:31:34.415909 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-beea14a3-5865-4fac-a8d8-7327d2637a85 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121633 Aug 07 01:31:34.416505 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 586/1152] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Aug 7 01:31:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:36.494204 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-82139183", "imageRef": "61a5d36e-02b5-4539-a08d-da7ec88c9d4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91170ab7-2045-48e1-96f7-b144ccdd6c44"}], "security_groups": [{"name": "tempest-securitygroup--399257067"}], "key_name": "tempest-keypair-945761289", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:36.598768 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] validate_networks() for [('91170ab7-2045-48e1-96f7-b144ccdd6c44', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:31:36.969684 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:31:36.970139 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:31:36.970646 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:31:36.971057 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:31:36.971467 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:31:36.981769 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:36.982279 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:36.982719 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:36.983444 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:36.983895 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:36.984317 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.002743 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:31:37.007482 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.quota [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Getting quotas for user b5c2fc3f3d5e4e7db1a13e24086e1f8e and project 48e13052e79e4d578da99b7c5f52d304. Resources: {'ram', 'instances', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:31:37.018373 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:31:37.021337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61a5d36e-02b5-4539-a08d-da7ec88c9d4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:31:37.136988 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a62f0cd6-becc-4c8a-b1f0-0d6268e55e15 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647509 Aug 07 01:31:37.137629 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 567/1153] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Aug 7 01:31:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:31:37.149713 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-dcce53b7-3bfc-4610-8d47-f329ae0f99dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:37.150352 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-dcce53b7-3bfc-4610-8d47-f329ae0f99dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:37.210757 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-dcce53b7-3bfc-4610-8d47-f329ae0f99dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:37.217658 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-dcce53b7-3bfc-4610-8d47-f329ae0f99dd tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1239 microversion: 2.1 time: 0.072320 Aug 07 01:31:37.218247 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 587/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:37 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:38.238285 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:38.243370 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:38.245156 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:38.245639 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:38.246139 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:38.246930 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:38.247374 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:38.247808 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:38.308865 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.316385 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cc1ed937-cabd-4014-a217-16ff818a70c8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1235 microversion: 2.1 time: 0.082638 Aug 07 01:31:38.316946 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 568/1155] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:38 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:39.340867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:39.341478 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:39.348472 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.348948 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.349547 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.350269 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.350717 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.354967 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.415955 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:39.423449 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-f8c5cf5c-fc85-4b89-9c74-6f3e22ab41bc tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1297 microversion: 2.1 time: 0.086827 Aug 07 01:31:39.424015 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 588/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:39 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:40.445373 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:40.446040 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:40.452659 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.453140 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.453577 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.454299 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.454750 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.455175 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.506653 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f89ac3f-a79d-4984-8df7-5d714f0c9217", "tag": "f0a19d82-3a33-4eef-af76-92adf62052c0"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:40.517068 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.517544 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.518004 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.528708 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] Creating event network-changed:f0a19d82-3a33-4eef-af76-92adf62052c0 for instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 on hv-cinder-maste Aug 07 01:31:40.533765 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-685dc458-9ede-46fd-8180-4c86489f0ae0 req-1f4c02f9-84f8-47ca-ae1c-7a36c3b525a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031513 Aug 07 01:31:40.534782 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 589/1157] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:40.658791 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:40.666413 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2ec64815-e3a8-4c20-836d-a6610102c9e5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.225745 Aug 07 01:31:40.666922 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 569/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:40 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:41.688660 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.689363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:41.696163 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.696644 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.697080 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.697763 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.698242 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.698666 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.832603 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:41.840232 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-375d91e7-1740-440b-a1ad-1e3722ac9981 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.156247 Aug 07 01:31:41.840792 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 590/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:41 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:42.860891 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:42.861491 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:42.867987 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.868460 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.868889 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.869571 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.870044 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.870463 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.000823 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:43.009476 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1331ff06-0467-4b2d-ad2a-ea3e5442c609 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.152416 Aug 07 01:31:43.010077 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 570/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:42 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:44.032473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:44.033499 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:44.041728 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.042405 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.043013 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.043682 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.044184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.044664 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.189164 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.196962 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a71c26c4-a7a2-4c82-a93c-48217ac9199f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.169313 Aug 07 01:31:44.199529 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 591/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:44 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:45.218790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:45.219490 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:45.225969 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.226453 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.226888 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.227584 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.228033 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.228455 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.355787 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:45.363560 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-084a0e46-ff30-4214-8361-5102b5822d01 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.148818 Aug 07 01:31:45.364115 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 571/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:45 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:46.186756 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f89ac3f-a79d-4984-8df7-5d714f0c9217", "name": "network-vif-plugged", "status": "completed", "tag": "f0a19d82-3a33-4eef-af76-92adf62052c0"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:46.197235 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.197651 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.198126 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.209353 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] Creating event network-vif-plugged:f0a19d82-3a33-4eef-af76-92adf62052c0 for instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 on hv-cinder-maste Aug 07 01:31:46.214551 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-b79fb71f-b47a-4319-ac6e-4c95147fcc11 req-24339998-55b5-4cd8-96d4-59bf3635cc71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Aug 07 01:31:46.215181 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 592/1163] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:46.384793 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:46.385466 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:46.392096 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.392575 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.393037 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.393937 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.394388 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.394853 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.561790 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.570127 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20084dd8-ba74-4546-b98d-e2db24673e32 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.189293 Aug 07 01:31:46.570706 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 572/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:46 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:47.589768 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell0:SELECT=6 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:47.594030 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:47.598645 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:47.601132 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.601616 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.602081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:47.602800 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.603243 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.603669 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:47.734206 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:47.742167 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5913b3b4-fcf9-449c-b847-50d2e3beb89e tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1364 microversion: 2.1 time: 0.153997 Aug 07 01:31:47.747433 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 593/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:47 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:48.763287 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:48.763936 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:48.765755 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:48.766427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:48.771728 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.772214 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.772647 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.773359 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.773855 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.774269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.907210 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.914939 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d6ed831-c40e-44d9-a092-b8f985d20c4a tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1553 microversion: 2.1 time: 0.155515 Aug 07 01:31:48.923539 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 573/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:48 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:48.935354 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:48.935847 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:48.942888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.943363 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.943792 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.944473 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.944919 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.945338 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:49.021217 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-aa5c6f19-2482-4544-8330-d5a45e978f17 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089639 Aug 07 01:31:49.021810 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 594/1167] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Aug 7 01:31:48 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:31:50.258708 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f89ac3f-a79d-4984-8df7-5d714f0c9217", "tag": "f0a19d82-3a33-4eef-af76-92adf62052c0"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:50.268979 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:50.272427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:50.272427 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:50.281119 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] Creating event network-changed:f0a19d82-3a33-4eef-af76-92adf62052c0 for instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 on hv-cinder-maste Aug 07 01:31:50.286734 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-63e3e001-e4fc-42b0-8b68-a45a677a3d91 req-aaf60426-8e74-4cc2-9d53-d59b321ca20c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085132 Aug 07 01:31:50.287346 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 574/1168] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:20.028641 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:32:20.029107 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:32:54.821515 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:54.822287 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG dbcounter [-] [118310] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:54.826430 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:54.826918 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:54.833328 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:54.842862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:54.842862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:54.842862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:54.842862 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:54.843278 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:54.859912 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-6c0d17df-bce9-4f72-9d72-f640a23746ef tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/ips" status: 200 len: 149 microversion: 2.1 time: 0.040230 Aug 07 01:32:54.860574 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 595/1169] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Aug 7 01:32:54 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:56.506082 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:56.506831 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=82 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:56.511570 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df14ad7-5bf2-4a6e-a980-d05a878cd6cf"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:56.514038 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:56.521062 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.521542 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.522017 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:56.522702 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.523265 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.523690 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.325278 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-198a9844-2a0b-49c0-be03-5aa2e55e6731 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "POST /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821291 Aug 07 01:32:57.325987 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 575/1170] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Aug 7 01:32:56 2022] POST /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:59.662973 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:59.663466 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:59.670496 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:59.670971 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:59.671404 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:59.672081 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:59.672528 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:59.672949 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:59.806002 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.objects.instance [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'services' on Instance uuid 0f89ac3f-a79d-4984-8df7-5d714f0c9217 {{(pid=118310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:59.983961 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d3e40d6c-7f4e-43f0-997a-4c206b4ab532 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments/1df14ad7-5bf2-4a6e-a980-d05a878cd6cf" status: 202 len: 0 microversion: 2.1 time: 0.325731 Aug 07 01:32:59.984752 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 596/1171] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Aug 7 01:32:59 2022] DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments/1df14ad7-5bf2-4a6e-a980-d05a878cd6cf => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:32:59.995470 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:59.998135 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:00.005190 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.005670 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.006130 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.006825 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.007443 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.007880 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.037149 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-08a588b1-7c4b-408a-ab11-33e21285a8d8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Aug 07 01:33:00.037875 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 576/1172] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:32:59 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:01.049818 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:01.052183 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:01.058795 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.059272 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.059702 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.060382 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.060827 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.061251 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.091500 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d4522ad3-7cab-425c-96f3-6a5990deadab tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 07 01:33:01.092043 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 597/1173] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:33:01 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:02.105159 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.107337 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.114492 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.116055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.116055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.116055 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.116508 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.116928 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.146433 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4056ec22-7f52-43df-8bb3-15b0a382b6da tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045305 Aug 07 01:33:02.146987 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 577/1174] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Aug 7 01:33:02 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:33:02.209583 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.210155 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.216736 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.217224 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.217662 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.218382 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.218838 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.219265 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.245965 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Going to try to terminate instance {{(pid=118310) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:33:02.493590 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-eaba3167-2b15-4aa6-8f56-fe7b68dc66fb tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 204 len: 0 microversion: 2.1 time: 0.288093 Aug 07 01:33:02.494288 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 598/1175] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:02 2022] DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:33:02.502378 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.502996 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.509330 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.509810 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.510269 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.510955 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.511547 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.511968 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.646109 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:02.654192 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5631d2c3-18dd-42d7-9068-cafb94e4b369 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1678 microversion: 2.1 time: 0.155656 Aug 07 01:33:02.654754 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 578/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:02 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:03.677014 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:03.677735 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:03.684099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.684571 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.685003 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.685684 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.686159 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.686577 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.819747 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.policy [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:03.827246 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-d632ce87-b2a8-41b0-ad13-61e9b07ea3b5 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1678 microversion: 2.1 time: 0.155336 Aug 07 01:33:03.827805 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 599/1177] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:03 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:04.848699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:04.849294 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:04.856024 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.856504 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.856939 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:04.857632 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.858184 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.858607 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.078067 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:05.085691 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cf78c072-7a61-4adb-aea6-6341456ebb80 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1678 microversion: 2.1 time: 0.240866 Aug 07 01:33:05.086289 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 579/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:04 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:05.367285 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f89ac3f-a79d-4984-8df7-5d714f0c9217", "name": "network-vif-deleted", "tag": "f0a19d82-3a33-4eef-af76-92adf62052c0"}]} {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:05.376897 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:05.377375 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:05.378038 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.391268 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.compute.server_external_events [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] Creating event network-vif-deleted:f0a19d82-3a33-4eef-af76-92adf62052c0 for instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 on hv-cinder-maste Aug 07 01:33:05.397166 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [req-59c7f5a6-8eb8-4dea-a3e3-da2bdb532719 req-aa8e967d-680b-4ed9-afa0-ea683e9becc2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100224 Aug 07 01:33:05.402194 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 600/1179] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:06.108143 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:06.108842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:06.116203 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.116770 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.117286 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.118098 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.118580 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.119334 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.154523 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.155014 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.155441 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.155890 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lazy-loading 'fault' on Instance uuid 0f89ac3f-a79d-4984-8df7-5d714f0c9217 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:06.199850 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.policy [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e13052e79e4d578da99b7c5f52d304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:06.208491 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6692dbc3-1e8f-4181-9c34-5d89b02bc577 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 200 len: 1329 microversion: 2.1 time: 0.104661 Aug 07 01:33:06.210057 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 580/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:06 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:07.231288 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.232010 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.238315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.238722 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.239151 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.239843 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.240290 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.240709 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.254502 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 HTTP/1.1 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:33:07.256141 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:07.257810 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '0f89ac3f-a79d-4984-8df7-5d714f0c9217'} Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:07.258906 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:07.260488 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.262142 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:07.262142 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-0ceff332-2c8f-47af-b097-878da17b1fb0 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 404 len: 111 microversion: 2.1 time: 0.030825 Aug 07 01:33:07.262142 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 601/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:07 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:07.266573 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1c92785b-d8f2-4cd0-9201-650667b08857 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '.version_select at 0x7fb7d191fb80>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.362202 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1c92785b-d8f2-4cd0-9201-650667b08857 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945761289" status: 202 len: 0 microversion: 2.1 time: 0.099345 Aug 07 01:33:07.363485 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 581/1182] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Aug 7 01:33:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945761289 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:33:09.385656 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:09.386203 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:09.392481 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.392962 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.393398 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.394867 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.395204 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.395636 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.409133 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 HTTP/1.1 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:33:09.411294 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.412885 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '0f89ac3f-a79d-4984-8df7-5d714f0c9217'} Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:09.413793 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.415438 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.416939 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:09.416939 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-b4819d00-40a8-4c55-bd03-ff5b2de65ce1 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 404 len: 111 microversion: 2.1 time: 0.030942 Aug 07 01:33:09.416939 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 602/1183] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:09 2022] DELETE /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:09.421612 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:09.422248 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 0f89ac3f-a79d-4984-8df7-5d714f0c9217] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:09.429669 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.430179 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.430619 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.431314 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.431766 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.432217 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.448581 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 HTTP/1.1 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:33:09.451089 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.452919 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '0f89ac3f-a79d-4984-8df7-5d714f0c9217'} Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:09.453703 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. Aug 07 01:33:09.455213 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:09.456663 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 0f89ac3f-a79d-4984-8df7-5d714f0c9217 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:09.456663 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-db8ed5f4-6a20-4a77-b4c1-35d625c13042 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217" status: 404 len: 111 microversion: 2.1 time: 0.035246 Aug 07 01:33:09.456663 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 582/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:09 2022] GET /compute/v2.1/servers/0f89ac3f-a79d-4984-8df7-5d714f0c9217 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:10.680803 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:10.681304 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:10.687690 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.688164 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.688596 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.689279 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.689727 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.690184 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.703074 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e HTTP/1.1 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:33:10.704606 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.706178 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '5e1af330-75cf-4efa-8101-9e01fc37856e'} Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:10.707115 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.708366 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.709602 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:10.709602 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-845c86f0-455e-4223-9d87-be38b7178fa8 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 404 len: 111 microversion: 2.1 time: 0.029027 Aug 07 01:33:10.709602 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 603/1185] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:10 2022] DELETE /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:10.714777 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:10.715393 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5e1af330-75cf-4efa-8101-9e01fc37856e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:10.722595 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.723104 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.723553 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.724245 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.724699 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.725119 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.738821 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e HTTP/1.1 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:33:10.740320 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.742017 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '5e1af330-75cf-4efa-8101-9e01fc37856e'} Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:10.742879 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. Aug 07 01:33:10.744329 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.745903 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5e1af330-75cf-4efa-8101-9e01fc37856e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:10.745903 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2704e989-87f5-495e-a15e-5a782efcaa55 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e" status: 404 len: 111 microversion: 2.1 time: 0.031029 Aug 07 01:33:10.745903 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 583/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:10 2022] GET /compute/v2.1/servers/5e1af330-75cf-4efa-8101-9e01fc37856e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:10.749906 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:10.750434 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:10.757819 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.758565 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.759136 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.759823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.760274 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.760698 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.773980 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb HTTP/1.1 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:33:10.775519 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.777068 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': 'f6a90fd7-deca-4c04-8ce2-57d629637fdb'} Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:10.778228 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.779683 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.781099 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:10.781099 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-5591053b-a948-4f83-880d-0f8629c00dc4 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 404 len: 111 microversion: 2.1 time: 0.030821 Aug 07 01:33:10.781099 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 604/1187] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:10 2022] DELETE /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:33:10.786118 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:10.786774 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: f6a90fd7-deca-4c04-8ce2-57d629637fdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:10.792730 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.793207 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.793642 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.794390 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.794842 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.795262 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.809190 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb HTTP/1.1 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:33:10.810739 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.812285 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': 'f6a90fd7-deca-4c04-8ce2-57d629637fdb'} Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:10.813402 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. Aug 07 01:33:10.814923 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:10.816276 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance f6a90fd7-deca-4c04-8ce2-57d629637fdb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:10.816276 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d361a22f-25d1-48f3-a18a-4ff9126a938c tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb" status: 404 len: 111 microversion: 2.1 time: 0.030531 Aug 07 01:33:10.816276 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 584/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:10 2022] GET /compute/v2.1/servers/f6a90fd7-deca-4c04-8ce2-57d629637fdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:12.064997 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:12.065491 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.compute.api [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118310) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:12.072411 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.072888 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.073315 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.074028 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.074474 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.074891 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG oslo_concurrency.lockutils [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.088032 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.wsgi [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: request: DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 HTTP/1.1 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept: application/json Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Accept-Encoding: identity Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Connection: close Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Length: 0 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Content-Type: application/json Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Host: 10.222.0.36 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: Openstack-System-Scope: None Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Id: None Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Domain-Name: None Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Identity-Status: Confirmed Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Is-Admin-Project: True Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Id: default Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Domain-Name: Default Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Role: reader,member Aug 07 01:33:12.089823 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Roles: reader,member Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Id: default Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Domain-Name: Default Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: method: > Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: exception: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.091630 dv-cinder-master-3-smb devstack@n-api.service[118310]: action_args: {'id': '5b9bc327-3bea-4b44-abfd-6b0d0fc131c0'} Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: {{(pid=118310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:12.092716 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.094154 dv-cinder-master-3-smb devstack@n-api.service[118310]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.097674 dv-cinder-master-3-smb devstack@n-api.service[118310]: DEBUG nova.api.openstack.wsgi [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. {{(pid=118310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:12.097674 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO nova.api.openstack.requestlog [None req-a3f3ed8e-0c99-4f74-aa7c-5fa3a96d484f tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 07 01:33:12.097674 dv-cinder-master-3-smb devstack@n-api.service[118310]: [pid: 118310|app: 0|req: 605/1189] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:12 2022] DELETE /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:12.102780 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:12.103413 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] [instance: 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:12.109693 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.110208 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.110633 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.111310 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Acquiring lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.111753 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.112166 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Lock "81a5e386-8ce3-4f54-95b2-9e719a5b2107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.125904 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] HTTP exception thrown: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Request method failure captured: Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 HTTP/1.1 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept: application/json Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Accept-Encoding: identity Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Connection: close Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Length: 0 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Content-Type: application/json Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Host: 10.222.0.36 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: Openstack-System-Scope: None Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Auth-Token: gAAAAABi7xS95N5C1thHF0nhU1Y4hwLeYvmHprj1HZL-QhX7vd4SaVeM9grAK-KcDGfEkV_Oipx5KshnoyAqCCdN-TkWnarcW90ZTzAv_Fj6-Hfb8wpsG7mhXPsZ0wMAJHRBaJvJR6-l81ipsWD_L73U7KnStBGmTNU_9UcMKgp6yUWnXTLEhxs Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Id: None Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Domain-Name: None Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Identity-Status: Confirmed Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Is-Admin-Project: True Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Id: default Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Domain-Name: Default Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Role: reader,member Aug 07 01:33:12.127398 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Roles: reader,member Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e13052e79e4d578da99b7c5f52d304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e13052e79e4d578da99b7c5f52d304", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Id: 48e13052e79e4d578da99b7c5f52d304 Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922413032 Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Id: default Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Domain-Name: Default Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Id: b5c2fc3f3d5e4e7db1a13e24086e1f8e Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1922413032-project Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: method: > Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: exception: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.129891 dv-cinder-master-3-smb devstack@n-api.service[118307]: action_args: {'id': '5b9bc327-3bea-4b44-abfd-6b0d0fc131c0'} Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:12.130800 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. Aug 07 01:33:12.132566 dv-cinder-master-3-smb devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Aug 07 01:33:12.134016 dv-cinder-master-3-smb devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] Returning 404 to user: Instance 5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:12.134016 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eebc4831-696a-442f-9f42-8c3247b50477 tempest-AttachVolumeNegativeTest-1922413032 tempest-AttachVolumeNegativeTest-1922413032-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0" status: 404 len: 111 microversion: 2.1 time: 0.030370 Aug 07 01:33:12.134016 dv-cinder-master-3-smb devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 585/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:12 2022] GET /compute/v2.1/servers/5b9bc327-3bea-4b44-abfd-6b0d0fc131c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:40.036941 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:35:40.037431 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:35:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:35:41.643769 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:35:41.644278 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:35:42.801709 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:35:42.802263 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:36:07.568883 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:36:07.569505 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:37:10.930931 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:37:10.931566 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:37:11.164343 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:37:11.164874 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:39:00.044607 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:39:00.045078 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:39:01.651383 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:39:01.651933 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:39:02.809794 dv-cinder-master-3-smb devstack@n-api.service[118310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:39:02.810384 dv-cinder-master-3-smb devstack@n-api.service[118310]: Sun Aug 7 01:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:39:27.577473 dv-cinder-master-3-smb devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:39:27.578031 dv-cinder-master-3-smb devstack@n-api.service[118307]: Sun Aug 7 01:39:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!